-- Logs begin at Tue 2021-11-16 15:24:41 UTC, end at Tue 2021-11-16 16:21:21 UTC. -- Nov 16 15:55:26.882791 dv-cinder-818098-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 16 15:55:26.891739 dv-cinder-818098-2-iscsi devstack@n-api.service[101158]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 16 15:55:26.893747 dv-cinder-818098-2-iscsi devstack@n-api.service[101158]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Nov 16 15:55:26 2021] *** Nov 16 15:55:26.893747 dv-cinder-818098-2-iscsi devstack@n-api.service[101158]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 16 15:55:26.893747 dv-cinder-818098-2-iscsi devstack@n-api.service[101158]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 16 15:55:26.893747 dv-cinder-818098-2-iscsi devstack@n-api.service[101158]: nodename: dv-cinder-818098-2-iscsi Nov 16 15:55:26.893747 dv-cinder-818098-2-iscsi devstack@n-api.service[101158]: machine: x86_64 Nov 16 15:55:26.893747 dv-cinder-818098-2-iscsi devstack@n-api.service[101158]: clock source: unix Nov 16 15:55:26.893747 dv-cinder-818098-2-iscsi devstack@n-api.service[101158]: pcre jit disabled Nov 16 15:55:26.893747 dv-cinder-818098-2-iscsi devstack@n-api.service[101158]: detected number of CPU cores: 4 Nov 16 15:55:26.893747 dv-cinder-818098-2-iscsi devstack@n-api.service[101158]: current working directory: / Nov 16 15:55:26.893747 dv-cinder-818098-2-iscsi devstack@n-api.service[101158]: detected binary path: /usr/bin/uwsgi-core Nov 16 15:55:26.894458 dv-cinder-818098-2-iscsi devstack@n-api.service[101158]: your processes number limit is 47680 Nov 16 15:55:26.894458 dv-cinder-818098-2-iscsi devstack@n-api.service[101158]: your memory page size is 4096 bytes Nov 16 15:55:26.894458 dv-cinder-818098-2-iscsi devstack@n-api.service[101158]: detected max file descriptor number: 2048 Nov 16 15:55:26.894458 dv-cinder-818098-2-iscsi devstack@n-api.service[101158]: lock engine: pthread robust mutexes Nov 16 15:55:26.894458 dv-cinder-818098-2-iscsi devstack@n-api.service[101158]: thunder lock: enabled Nov 16 15:55:26.894458 dv-cinder-818098-2-iscsi devstack@n-api.service[101158]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 16 15:55:26.894458 dv-cinder-818098-2-iscsi devstack@n-api.service[101158]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 16 15:55:26.939076 dv-cinder-818098-2-iscsi devstack@n-api.service[101158]: Python main interpreter initialized at 0x565297c839c0 Nov 16 15:55:26.939076 dv-cinder-818098-2-iscsi devstack@n-api.service[101158]: python threads support enabled Nov 16 15:55:26.939076 dv-cinder-818098-2-iscsi devstack@n-api.service[101158]: your server socket listen backlog is limited to 100 connections Nov 16 15:55:26.939076 dv-cinder-818098-2-iscsi devstack@n-api.service[101158]: your mercy for graceful operations on workers is 90 seconds Nov 16 15:55:26.939444 dv-cinder-818098-2-iscsi devstack@n-api.service[101158]: mapped 403077 bytes (393 KB) for 2 cores Nov 16 15:55:26.939555 dv-cinder-818098-2-iscsi devstack@n-api.service[101158]: *** Operational MODE: preforking *** Nov 16 15:55:26.939753 dv-cinder-818098-2-iscsi devstack@n-api.service[101158]: *** uWSGI is running in multiple interpreter mode *** Nov 16 15:55:26.939753 dv-cinder-818098-2-iscsi devstack@n-api.service[101158]: spawned uWSGI master process (pid: 101158) Nov 16 15:55:26.939932 dv-cinder-818098-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 16 15:55:26.944527 dv-cinder-818098-2-iscsi devstack@n-api.service[101158]: spawned uWSGI worker 1 (pid: 101159, cores: 1) Nov 16 15:55:26.944527 dv-cinder-818098-2-iscsi devstack@n-api.service[101158]: spawned uWSGI worker 2 (pid: 101160, cores: 1) Nov 16 15:55:26.944527 dv-cinder-818098-2-iscsi devstack@n-api.service[101158]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 16 15:55:28.576168 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 16 15:55:28.576168 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: from cryptography.utils import int_from_bytes Nov 16 15:55:28.576862 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 16 15:55:28.576862 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: from cryptography.utils import int_from_bytes Nov 16 15:55:28.584044 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 16 15:55:28.584044 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: from cryptography.utils import int_from_bytes Nov 16 15:55:28.584543 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 16 15:55:28.584543 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: from cryptography.utils import int_from_bytes Nov 16 15:55:31.103229 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 16 15:55:31.103813 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 16 15:55:31.104000 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 16 15:55:31.104363 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 16 15:55:31.104618 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 16 15:55:31.104999 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.105323 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.105642 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.105957 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.106286 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.106595 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.106914 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.107234 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.107587 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.107849 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.108045 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 16 15:55:31.108426 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.108509 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 16 15:55:31.108589 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818098-2-iscsi {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.108768 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 16 15:55:31.108874 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.109582 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.109893 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.110052 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 16 15:55:31.110213 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.110331 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 16 15:55:31.110517 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.110703 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.110840 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.111026 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.111143 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.111346 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.111664 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.111785 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.112008 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.112129 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.112319 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.112435 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.112640 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.112761 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.112961 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.113084 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.113287 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.113392 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.113549 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.113649 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.113858 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.113963 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.114179 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818098-2-iscsi {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.114267 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.114500 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.114592 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.114804 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.114903 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.115113 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.115201 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818098-2-iscsi {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.115427 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.115571 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.115760 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.115854 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.116079 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.116174 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.116383 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.116529 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.116833 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.116919 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.117140 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.117227 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.117461 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.117562 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.117794 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.117881 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.118100 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.118194 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.118427 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.118515 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.118747 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.118840 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.119064 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.119233 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.119370 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.119500 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.119695 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.119790 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.120005 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.120099 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.120317 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.120425 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818098-2-iscsi {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.120637 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.120732 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.120941 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.121032 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.121244 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.121360 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.121496 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.121673 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.121799 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.121981 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.122120 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.122286 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.122439 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.122601 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.122759 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.122920 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.123021 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.123224 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.123318 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.123563 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.123717 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.123881 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.124025 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.124189 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.124278 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.124495 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.124589 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.125498 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.125809 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.126116 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.126424 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.126732 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.126869 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.127038 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.127212 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.127356 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.127559 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.127696 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.127895 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.128017 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.128211 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.128325 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.128524 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.128641 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.128777 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.129038 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.129126 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.129291 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.129411 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.129598 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.129736 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.129935 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.130059 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.130252 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.130339 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.130551 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.130660 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.130863 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.130955 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.131181 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.131268 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.131505 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.131608 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.131814 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.132181 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.132181 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.132334 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.132423 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.132506 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.132703 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.132791 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.133009 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.133104 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.133263 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.133387 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.133562 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.133694 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.133864 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.134011 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.134181 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.134323 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.134484 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.134640 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.134786 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.134946 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.135089 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.135263 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.135390 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.135682 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.135772 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.135932 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.136029 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.136236 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.136323 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.136568 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.136662 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.136875 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.136968 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.137176 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.137271 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.137480 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.137566 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.137784 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.137879 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.138084 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.138178 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.138385 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.138472 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.138688 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.138775 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.138992 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.139078 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.139294 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.139390 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.139621 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.139723 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.139868 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.139954 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.140165 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.140279 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.140587 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.140894 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.140991 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.141216 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.141318 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.141518 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.141616 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.141825 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.141939 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.142136 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.142224 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.142431 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.142518 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.142732 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.142817 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.143035 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.143151 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.143336 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.143440 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.143666 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.143758 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.143968 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.144067 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.144271 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.144361 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.144573 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.144663 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.144870 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.144972 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.145170 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.145266 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.145475 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.145571 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.145775 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.145947 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.146075 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.146189 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.146373 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.146460 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.146668 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.146764 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.146967 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.147054 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.147284 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.147372 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.147608 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.147710 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.147912 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.148005 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.148213 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.148300 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.148516 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.148611 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.148846 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.148932 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.149563 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.149919 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.149919 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.150080 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.150170 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.150250 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.150328 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.150618 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.150829 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.150995 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.151170 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.151280 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.151508 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.151606 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.151819 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.151908 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.152118 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.152210 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.152418 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.152505 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.152719 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.152807 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.153018 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.153104 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.153317 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.153412 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.153615 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.153704 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.153908 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.154057 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.154219 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.154316 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.154533 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.154620 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.154837 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.154923 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.155140 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.155237 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.155440 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.155575 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.155778 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 15:55:31.155961 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.156188 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.156623 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.156771 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.157034 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.157260 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.157377 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.157605 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.157709 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.157948 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.158034 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.158263 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.158364 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.158588 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.158687 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.158901 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.158989 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.159217 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.159317 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.159550 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.159655 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.159867 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.159956 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.160172 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.160258 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.160479 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.160567 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.160793 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.160901 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.161106 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.161204 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.161426 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.161515 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.161739 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.161841 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.162052 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.162145 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.162360 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.162448 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.162664 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.162751 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.162967 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.163055 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.163278 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.163366 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.163604 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.163696 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.163911 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.164008 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.164238 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.164329 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.164545 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.164632 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.164863 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.164958 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.165167 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.165255 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.165477 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.165563 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.165785 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.165884 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.166087 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.166182 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.166394 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.166486 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.166701 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.166796 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.167005 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.167100 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.167326 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.167413 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.167659 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.167749 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.167962 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.168092 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.168281 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.168370 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.168587 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.168678 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.168893 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.168982 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.169193 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.169279 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.169496 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.169592 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.169800 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.169889 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.170102 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.170204 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.170416 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.170504 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.170722 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.170808 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.171029 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.171137 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.171362 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.171977 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.172234 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.172542 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.172681 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.172868 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.173001 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.173191 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.173315 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.173507 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.173623 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.173816 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.173937 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.174125 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.174252 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.174432 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.174541 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.174735 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.174862 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.175040 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.175173 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.175353 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.175507 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.175691 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.175825 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.175998 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.176134 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.176302 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.176437 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.176605 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.176751 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.176909 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.177061 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.177230 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.177374 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.177536 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.177684 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.177840 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.178004 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.178143 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.178314 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.178446 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.178623 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.178787 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.178952 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.179092 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.179278 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.179429 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.179613 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.179783 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.179938 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.180103 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.180386 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.180479 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.180660 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.180748 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.180971 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.181113 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.181276 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.181429 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.181585 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.181740 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.181889 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.182050 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.182193 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.182364 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.182500 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.182681 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.182804 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.182991 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.183107 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.183309 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.183397 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.183643 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.183748 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.183969 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.184058 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.184279 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.184367 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.184599 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.184699 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.184904 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.184991 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.185203 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.185297 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.185506 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.185602 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.185846 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.185940 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.186149 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.186237 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.186473 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.186560 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.186785 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.186879 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.187140 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.187749 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.187980 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.188292 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.188571 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.188672 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.188892 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.188979 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.189208 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.189297 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.189517 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.189604 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.189827 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.189913 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.190132 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.190220 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.190444 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.190530 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.190750 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.190843 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.191061 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.191149 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.191364 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.191450 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.191700 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.191806 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.192022 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.192117 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.192334 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.192423 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.192645 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.192744 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.192945 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.193033 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.193259 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.193347 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.193565 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.193660 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.193873 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.193961 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.194180 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.194268 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.194485 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.194584 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.194788 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.194875 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.195094 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.195181 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.195407 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.195526 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.195741 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.195830 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.196046 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.196132 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.196350 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.196445 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.196661 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.196748 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.196966 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.197052 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.197266 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.197359 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.197567 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.197655 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.197877 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.197966 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.198181 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.198268 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.198494 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.198579 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.198793 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.198879 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.199103 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.199193 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.199410 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.199526 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.199738 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.199838 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.200061 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.200148 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.200368 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.200454 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.200670 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.200766 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.200973 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.201060 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.201276 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.201371 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.201584 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.201720 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.201887 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.201975 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.202189 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.202284 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.202496 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.202593 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.202936 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.203064 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.203383 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.203572 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.203723 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.203889 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.204035 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.204201 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.204347 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.204518 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.204671 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.204828 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.204984 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.205134 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.205293 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.205438 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.205607 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.205750 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.205919 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.206072 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.206226 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.206386 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.206535 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.206708 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.206857 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.207031 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.207166 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.207335 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.207489 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.207663 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.207806 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.207986 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.208109 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.208293 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.208419 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.208598 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.208733 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.208900 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.209203 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.209299 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.209544 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.209633 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.209853 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.209946 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.210158 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.210262 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.210471 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.210558 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.210787 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.210873 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.211094 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.211182 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.211404 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.211509 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.211736 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.211823 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.212042 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.212140 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.212362 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.212457 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.212673 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.212760 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.212974 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.213061 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.213279 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.213366 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.213581 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.213667 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.213886 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.213973 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.214186 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.214271 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.214494 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.214591 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.214797 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.214889 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.215099 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.215186 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.215406 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.215558 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.215734 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.215823 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.216042 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.216140 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.216353 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.216484 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.216663 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.216909 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.216996 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.217239 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.217327 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.217552 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.217650 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.217855 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.217942 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.218156 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.218251 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.218499 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.218833 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.219031 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.219120 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.219385 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.219496 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.219747 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.219838 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.220067 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.220162 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.220376 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.220463 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.220688 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.220778 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.220994 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.221082 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.221300 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.221393 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.221604 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.221693 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.221905 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.221990 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.222208 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.222295 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.222511 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.222598 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.222812 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.222907 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.223112 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.223211 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.223414 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.223547 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.223742 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.223830 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.224052 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.224177 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.224353 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.224527 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.224651 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.224737 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.224949 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.225043 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.225250 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.225339 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.225560 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.225647 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.225859 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.225953 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.226159 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.226252 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.226455 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.226542 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.226757 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.226845 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.227059 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.227157 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.227363 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.227450 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.227688 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.227788 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.228001 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.228092 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.228302 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.228389 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.228603 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.228704 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.228902 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.228979 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.229205 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.229299 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.229509 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.229605 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.229809 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.229896 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.230115 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.230201 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.230421 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.230516 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.230721 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.230808 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.231018 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.231104 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.231321 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.231408 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.231645 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.231734 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.231949 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.232035 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.232252 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.232342 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.232548 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.232640 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.233076 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.233175 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.233267 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.233351 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.233431 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.233513 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.233737 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.233825 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.234650 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.234796 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.235226 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.235621 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.236104 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.236463 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.236717 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.237089 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.237425 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.237869 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.238181 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.238524 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.239712 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.240079 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.240281 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.240433 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.240622 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.240791 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.240977 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.242153 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.242244 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.242491 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.242580 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.242820 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.242919 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.243147 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.243238 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.243502 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.243595 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.243835 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.243926 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.244156 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.244242 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.244477 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.244574 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.244805 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.244894 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.245124 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.245217 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.245441 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.245538 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.245761 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.245906 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.246084 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.246182 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.246397 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.246495 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.246708 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.246796 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.247021 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.247115 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.247334 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.247430 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.247668 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.247756 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.247978 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.248066 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.248298 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.248386 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.248611 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.248706 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.248923 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.249017 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.249249 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.249338 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.250314 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.250452 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.250630 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.250759 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.250982 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.251114 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.251284 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.251400 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.251621 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.251746 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.251938 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.252064 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.252252 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.252383 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.252607 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.252704 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.252922 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.253010 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.253288 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.253376 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.253601 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.253703 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.253915 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.254002 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.254232 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.254321 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.254544 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.254641 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.254858 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.254946 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.255170 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.255265 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.255492 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.255598 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.255818 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.255905 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.256128 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.256259 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.256436 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.256532 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.256744 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.256843 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.257051 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.257145 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.257366 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.257463 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.257673 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.257760 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.257987 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.258121 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.258315 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.258436 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.258652 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.258739 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.258984 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.259071 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.259295 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.259383 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.259645 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.259734 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.259964 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.260064 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.260278 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.260367 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.260583 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.260669 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.260897 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.261020 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.261214 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.261338 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.261533 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.261653 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.261850 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.261971 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.262167 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.262277 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.262483 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.262570 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.262795 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.262891 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.263111 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.263199 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.263425 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.263564 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.263761 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.263852 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.264091 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.264179 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.264407 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.264500 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.264713 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.264801 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.265022 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.265109 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.265334 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.265643 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.265772 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.265952 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.266152 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.266390 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.266478 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.266709 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.266883 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.267027 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.267199 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.267338 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.267536 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.267681 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.267870 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.267999 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.268198 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.268318 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.268526 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.268647 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.268835 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.268956 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.269151 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.269380 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.269468 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.269697 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.269786 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.270021 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.270108 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.270338 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.270426 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.270648 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.270743 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.270956 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.271044 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.271272 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.271373 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.271627 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.271718 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.271939 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.272038 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.272250 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.272352 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.272560 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.272647 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.272887 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.272975 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.273197 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.273293 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.273524 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.273616 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.273894 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.273982 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.274204 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.274302 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.274512 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.274607 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.275090 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.275226 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.275399 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.275570 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.275732 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.275887 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.276056 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.276217 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.276362 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.276547 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.276677 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.276878 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.276992 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.277191 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.277370 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.277510 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.277609 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.277824 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.277919 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.278154 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.278242 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.278480 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.278575 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.278794 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.278880 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.279106 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.279193 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.279413 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.279563 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.279757 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.279846 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.280065 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.280152 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.280391 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.280479 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.280699 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.280786 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.281087 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.281178 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.281491 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.281684 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.281811 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.281999 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.282140 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.282348 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.282475 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.282661 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.282788 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.282987 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.283098 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.283320 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.283417 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.283679 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.283773 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.283995 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.284092 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.284334 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.284424 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.284651 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.284738 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.284968 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.285057 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.285284 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.285373 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.285598 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.285691 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.285903 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.285991 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.286209 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.286299 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.286521 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.286609 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.286828 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.286923 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.287133 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.287226 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.287438 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.287609 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.287779 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.287877 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.288079 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.288167 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.288386 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.288473 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.288690 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.288787 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.289014 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.289109 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.289319 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.289414 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.289626 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.289757 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.289937 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.290025 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.290245 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.290332 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.290557 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.290654 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.290862 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.290949 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.291205 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.291293 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.291538 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.291632 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.291875 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.291972 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.292197 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.292285 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.292523 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.292613 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.292845 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.292938 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.293154 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.293240 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.293480 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.293575 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.293790 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.293900 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.294101 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.294189 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.294413 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.294501 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.294723 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.294817 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.295034 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.295132 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.295346 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.295434 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.295683 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.295782 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.295992 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.296094 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.296299 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.296387 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.297111 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.297202 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.297444 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.297594 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.297825 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.298057 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.298145 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.298386 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.298473 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.298703 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.298792 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.299014 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.299101 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.299327 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.299532 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.299668 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.299757 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.299985 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.300072 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.300296 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.300398 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.300606 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.300694 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.300916 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.301011 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.301231 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.301327 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.301559 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.301647 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.301880 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.301968 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.302208 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.302305 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.302534 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.302621 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.302848 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.302941 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.303164 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.303253 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.303495 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.303588 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.303816 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.303903 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.304135 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.304225 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.304454 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.304548 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.304770 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.304866 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.305086 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.305175 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.305402 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.305497 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.305716 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.305953 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.306043 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.306290 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.306378 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.306613 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.306702 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.306925 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.307020 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.307236 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.307325 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.307577 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.307666 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.307891 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.307988 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.308207 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.308301 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.308524 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.308621 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.308841 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.308936 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.309159 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.309248 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.309470 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.309566 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.309785 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.309873 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.310101 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.310188 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.310452 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.310620 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.310775 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.310942 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.311095 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.311276 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.311415 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.311630 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.311760 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.311957 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.312738 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.312842 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.313105 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.313198 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.313425 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.313513 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.313736 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.313886 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.314043 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.314132 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.314352 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.314439 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.314661 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.314758 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.314966 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.315055 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.315288 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.315375 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.315622 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.315728 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.315929 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.316024 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.316243 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.316338 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.316550 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.316649 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.316869 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.317090 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.317201 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.317443 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.317539 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.317761 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.317850 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.318088 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.318175 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.318415 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.318516 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.318731 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.318818 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.319037 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.319302 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.319391 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.319653 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.319744 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.319997 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.320131 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.320315 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.320416 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.320626 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.320715 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.320940 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.321029 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.321246 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.321351 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.321556 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.321645 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.321865 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.321954 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.322168 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.322269 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.322478 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.322566 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.322781 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.322869 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.323091 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.323181 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.323400 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.323523 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.323730 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.323821 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.324037 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.324179 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.324347 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.324436 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.324651 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.324740 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.324955 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.325181 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.325277 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.325534 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.325623 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.325844 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.325944 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.326147 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.326236 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.326454 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.326542 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.326759 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.326856 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.327069 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.327157 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.327373 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.327535 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.327722 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.327845 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.328029 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.328155 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.328355 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.328454 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.328660 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.328751 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.328962 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.329057 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.329270 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.329359 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.329579 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.329668 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.329889 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.329979 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.330204 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.330319 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.330513 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.330614 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.330821 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.330918 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.331153 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.331250 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.331506 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.331703 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.331804 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.332086 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.332177 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.332400 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.332488 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.332710 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.332797 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.333018 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.333113 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.333327 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.333424 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.333636 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.333724 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.333960 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.334088 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.334263 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.334353 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.334572 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.334673 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.334879 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.334976 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.335188 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.335282 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.335512 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.335604 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.335826 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.335931 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.336132 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.336222 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.336438 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.336526 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.336747 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.336844 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.337054 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.337142 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.337372 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.337459 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.337688 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.337791 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.338003 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.338113 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.338318 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.338406 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.338632 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.338720 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.338939 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.339026 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.339249 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.339348 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.339585 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.339837 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.339926 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.340199 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.340361 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.340535 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.340635 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.340846 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.340934 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.341150 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.341238 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.341510 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.341606 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.341824 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.341914 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.342136 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.342224 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.342464 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.342554 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.342780 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.342868 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.343096 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.343189 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.343503 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.343829 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.344147 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.344466 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.344782 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.345097 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.345413 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.345757 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.346083 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.346415 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.346737 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.346914 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.347070 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.347229 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.347381 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.347569 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.347793 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.347961 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.348111 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.348250 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.348402 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.348523 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.348700 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.348845 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.349187 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.349341 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.349509 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.349828 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.349930 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.350145 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.350431 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.350874 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.351203 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.351560 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.351903 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.352060 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.352212 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.352364 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.352544 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.352682 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.353027 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.353125 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.353405 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.353670 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.353759 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.353999 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.354270 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.354360 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.354652 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.354878 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.354975 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.355291 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.355550 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.355676 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.356003 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.356146 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.356326 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.356503 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.356657 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.356810 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.356973 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.357134 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.357307 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.357470 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.357625 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.357837 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.357996 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.358141 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.358297 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.358451 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.358594 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.358738 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.358868 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.359641 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.359766 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.360002 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.360282 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.360507 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.360749 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.360913 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.361088 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.361243 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.361391 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.361541 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.361726 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.361901 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.362052 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.362216 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.362378 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.362527 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.362678 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.362838 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.362983 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.363122 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.363275 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.363418 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.363631 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.363832 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.363961 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.364220 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.364308 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.364630 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.364824 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.364946 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.365303 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.365417 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.365640 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.365800 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.365945 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.366136 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.366287 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.366449 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.366582 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.366783 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 16 15:55:31.366928 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.367111 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.367444 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.367794 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.368120 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.368457 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.368784 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.369110 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.369429 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.369748 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.370071 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.370394 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.370728 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.371062 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.371398 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.371773 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.372126 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.372446 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.372798 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.373132 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.373452 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.373772 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.374085 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 15:55:31.374333 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 16 15:55:31.390576 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG oslo_db.sqlalchemy.engines [None req-0256ddd8-9c31-4f88-b495-ab156a34df06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101160) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 15:55:31.397568 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG oslo_db.sqlalchemy.engines [None req-4555c5d5-73cd-4d7c-88bb-3ca4fea70130 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101159) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 15:55:31.458500 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.context [None req-0256ddd8-9c31-4f88-b495-ab156a34df06 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),153e4b82-24f7-482f-a6a4-3a6422fd3ad2(cell1) {{(pid=101160) load_cells /opt/stack/nova/nova/context.py:464}} Nov 16 15:55:31.462734 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG oslo_concurrency.lockutils [None req-0256ddd8-9c31-4f88-b495-ab156a34df06 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 15:55:31.464340 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG oslo_concurrency.lockutils [None req-0256ddd8-9c31-4f88-b495-ab156a34df06 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 15:55:31.465155 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG oslo_concurrency.lockutils [None req-0256ddd8-9c31-4f88-b495-ab156a34df06 None None] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 15:55:31.466354 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.context [None req-4555c5d5-73cd-4d7c-88bb-3ca4fea70130 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),153e4b82-24f7-482f-a6a4-3a6422fd3ad2(cell1) {{(pid=101159) load_cells /opt/stack/nova/nova/context.py:464}} Nov 16 15:55:31.467063 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG oslo_concurrency.lockutils [None req-0256ddd8-9c31-4f88-b495-ab156a34df06 None None] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 15:55:31.471564 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG oslo_concurrency.lockutils [None req-4555c5d5-73cd-4d7c-88bb-3ca4fea70130 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101159) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 15:55:31.473133 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG oslo_concurrency.lockutils [None req-4555c5d5-73cd-4d7c-88bb-3ca4fea70130 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101159) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 15:55:31.473943 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG oslo_concurrency.lockutils [None req-4555c5d5-73cd-4d7c-88bb-3ca4fea70130 None None] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101159) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 15:55:31.475869 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG oslo_concurrency.lockutils [None req-4555c5d5-73cd-4d7c-88bb-3ca4fea70130 None None] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101159) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 15:55:31.478295 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG oslo_db.sqlalchemy.engines [None req-0256ddd8-9c31-4f88-b495-ab156a34df06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101160) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 15:55:31.480804 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG oslo_db.sqlalchemy.engines [None req-0256ddd8-9c31-4f88-b495-ab156a34df06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101160) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 15:55:31.488641 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG oslo_db.sqlalchemy.engines [None req-4555c5d5-73cd-4d7c-88bb-3ca4fea70130 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101159) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 15:55:31.491685 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG oslo_db.sqlalchemy.engines [None req-4555c5d5-73cd-4d7c-88bb-3ca4fea70130 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101159) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 15:55:31.752264 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG oslo_db.sqlalchemy.engines [None req-0256ddd8-9c31-4f88-b495-ab156a34df06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101160) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 15:55:31.758729 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG oslo_db.sqlalchemy.engines [None req-4555c5d5-73cd-4d7c-88bb-3ca4fea70130 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101159) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 15:55:32.100287 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: WARNING keystonemiddleware.auth_token [None req-0256ddd8-9c31-4f88-b495-ab156a34df06 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 16 15:55:32.100978 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: WARNING keystonemiddleware.auth_token [None req-4555c5d5-73cd-4d7c-88bb-3ca4fea70130 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 16 15:55:32.106802 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: WARNING keystonemiddleware.auth_token [None req-0256ddd8-9c31-4f88-b495-ab156a34df06 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 16 15:55:32.107414 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: WARNING keystonemiddleware.auth_token [None req-4555c5d5-73cd-4d7c-88bb-3ca4fea70130 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 16 15:55:32.331871 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: WARNING keystonemiddleware.auth_token [None req-0256ddd8-9c31-4f88-b495-ab156a34df06 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 16 15:55:32.333359 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: WARNING keystonemiddleware.auth_token [None req-4555c5d5-73cd-4d7c-88bb-3ca4fea70130 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 16 15:55:32.337012 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: WARNING keystonemiddleware.auth_token [None req-0256ddd8-9c31-4f88-b495-ab156a34df06 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 16 15:55:32.338479 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: WARNING keystonemiddleware.auth_token [None req-4555c5d5-73cd-4d7c-88bb-3ca4fea70130 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 16 15:55:32.342452 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x565297c839c0 pid: 101160 (default app) Nov 16 15:55:32.343897 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x565297c839c0 pid: 101159 (default app) Nov 16 15:55:32.344605 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi [None req-0256ddd8-9c31-4f88-b495-ab156a34df06 None None] Calling method '>' {{(pid=101160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 15:55:32.345768 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: INFO nova.api.openstack.requestlog [None req-0256ddd8-9c31-4f88-b495-ab156a34df06 None None] 10.222.0.46 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001713 Nov 16 15:55:32.346184 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: [pid: 101160|app: 0|req: 1/1] 10.222.0.46 () {50 vars in 788 bytes} [Tue Nov 16 15:55:32 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 15:56:53.682801 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi [None req-4555c5d5-73cd-4d7c-88bb-3ca4fea70130 None None] Calling method '>' {{(pid=101159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 15:56:53.684486 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: INFO nova.api.openstack.requestlog [None req-4555c5d5-73cd-4d7c-88bb-3ca4fea70130 None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002080 Nov 16 15:56:53.687767 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: [pid: 101159|app: 0|req: 1/2] 10.222.0.46 () {54 vars in 930 bytes} [Tue Nov 16 15:56:53 2021] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 15:56:54.249934 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi [None req-df36991c-17a1-457b-9b82-3f8a59eb36cf admin admin] Calling method '>' {{(pid=101160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 15:56:54.279789 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: INFO nova.api.openstack.requestlog [None req-df36991c-17a1-457b-9b82-3f8a59eb36cf admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.587975 Nov 16 15:56:54.296469 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: [pid: 101160|app: 0|req: 2/3] 10.222.0.46 () {60 vars in 1291 bytes} [Tue Nov 16 15:56:53 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 15:56:56.599745 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi [None req-4555c5d5-73cd-4d7c-88bb-3ca4fea70130 None None] Calling method '>' {{(pid=101159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 15:56:56.600751 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: INFO nova.api.openstack.requestlog [None req-4555c5d5-73cd-4d7c-88bb-3ca4fea70130 None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Nov 16 15:56:56.601133 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: [pid: 101159|app: 0|req: 2/4] 10.222.0.46 () {54 vars in 930 bytes} [Tue Nov 16 15:56:56 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 15:56:56.667684 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi [None req-ed7a57f0-318b-4d21-a914-1ab98704cfe6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 1, "id": "c1", "vcpus": 1, "rxtx_factor": 1.0, "name": "cirros256"}} {{(pid=101160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 15:56:56.688743 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 15:56:56.688743 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: warnings.warn(msg) Nov 16 15:56:56.719850 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: INFO nova.api.openstack.requestlog [None req-ed7a57f0-318b-4d21-a914-1ab98704cfe6 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.111294 Nov 16 15:56:56.728198 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: [pid: 101160|app: 0|req: 3/5] 10.222.0.46 () {64 vars in 1282 bytes} [Tue Nov 16 15:56:56 2021] POST /compute/v2.1/flavors => generated 407 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 15:56:57.073327 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi [None req-8cb023e0-6879-4d38-93f0-40fe80641cd9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 15:56:57.075711 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 15:56:57.075711 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: warnings.warn(msg) Nov 16 15:56:57.124077 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: INFO nova.api.openstack.requestlog [None req-8cb023e0-6879-4d38-93f0-40fe80641cd9 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.394081 Nov 16 15:56:57.124668 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: [pid: 101159|app: 0|req: 3/6] 10.222.0.46 () {64 vars in 1335 bytes} [Tue Nov 16 15:56:56 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 15:56:59.503885 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi [None req-ed7a57f0-318b-4d21-a914-1ab98704cfe6 admin admin] Calling method '>' {{(pid=101160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 15:56:59.505050 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: INFO nova.api.openstack.requestlog [None req-ed7a57f0-318b-4d21-a914-1ab98704cfe6 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001647 Nov 16 15:56:59.505570 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: [pid: 101160|app: 0|req: 4/7] 10.222.0.46 () {54 vars in 930 bytes} [Tue Nov 16 15:56:59 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 15:56:59.624169 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi [None req-2b33d7e4-8068-447d-bf8b-f37c88c4394c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 512, "vcpus": 1, "name": "ds512M", "disk": 5}} {{(pid=101159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 15:56:59.642964 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 15:56:59.642964 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: warnings.warn(msg) Nov 16 15:56:59.663788 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: INFO nova.api.openstack.requestlog [None req-2b33d7e4-8068-447d-bf8b-f37c88c4394c admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.150659 Nov 16 15:56:59.667540 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: [pid: 101159|app: 0|req: 4/8] 10.222.0.46 () {64 vars in 1282 bytes} [Tue Nov 16 15:56:59 2021] POST /compute/v2.1/flavors => generated 404 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 15:56:59.678099 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi [None req-891ad4bf-68ba-485b-a1ee-6340b79a4d7b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 15:56:59.679746 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 15:56:59.679746 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: warnings.warn(msg) Nov 16 15:56:59.714118 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: INFO nova.api.openstack.requestlog [None req-891ad4bf-68ba-485b-a1ee-6340b79a4d7b admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039634 Nov 16 15:56:59.715373 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: [pid: 101160|app: 0|req: 5/9] 10.222.0.46 () {64 vars in 1335 bytes} [Tue Nov 16 15:56:59 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 15:57:02.210906 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi [None req-2b33d7e4-8068-447d-bf8b-f37c88c4394c admin admin] Calling method '>' {{(pid=101159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 15:57:02.212001 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: INFO nova.api.openstack.requestlog [None req-2b33d7e4-8068-447d-bf8b-f37c88c4394c admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Nov 16 15:57:02.212407 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: [pid: 101159|app: 0|req: 5/10] 10.222.0.46 () {54 vars in 930 bytes} [Tue Nov 16 15:57:02 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 15:57:02.274632 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi [None req-fd5995ca-0c98-4293-b75d-8c38926f9e89 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "disk": 10, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "name": "ds1G", "vcpus": 1, "id": "d2"}} {{(pid=101160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 15:57:02.295281 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: INFO nova.api.openstack.requestlog [None req-fd5995ca-0c98-4293-b75d-8c38926f9e89 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076164 Nov 16 15:57:02.296050 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: [pid: 101160|app: 0|req: 6/11] 10.222.0.46 () {64 vars in 1282 bytes} [Tue Nov 16 15:57:02 2021] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 15:57:02.307906 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi [None req-74270138-8ff6-48b7-878d-359dfb5830bc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 15:57:02.330754 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: INFO nova.api.openstack.requestlog [None req-74270138-8ff6-48b7-878d-359dfb5830bc admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026400 Nov 16 15:57:02.331343 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: [pid: 101159|app: 0|req: 6/12] 10.222.0.46 () {64 vars in 1335 bytes} [Tue Nov 16 15:57:02 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 15:57:04.640370 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi [None req-fd5995ca-0c98-4293-b75d-8c38926f9e89 admin admin] Calling method '>' {{(pid=101160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 15:57:04.641315 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: INFO nova.api.openstack.requestlog [None req-fd5995ca-0c98-4293-b75d-8c38926f9e89 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Nov 16 15:57:04.641720 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: [pid: 101160|app: 0|req: 7/13] 10.222.0.46 () {54 vars in 930 bytes} [Tue Nov 16 15:57:04 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 15:57:04.700891 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi [None req-6f1e2535-b676-4147-83e5-3c381572ca2f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 2048, "vcpus": 2, "disk": 10, "id": "d3", "name": "ds2G", "swap": 0}} {{(pid=101159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 15:57:04.720675 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: INFO nova.api.openstack.requestlog [None req-6f1e2535-b676-4147-83e5-3c381572ca2f admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072536 Nov 16 15:57:04.721387 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: [pid: 101159|app: 0|req: 7/14] 10.222.0.46 () {64 vars in 1282 bytes} [Tue Nov 16 15:57:04 2021] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 15:57:04.735747 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi [None req-f6134689-2e92-48b3-9943-cba8525f1fc1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 15:57:04.759323 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: INFO nova.api.openstack.requestlog [None req-f6134689-2e92-48b3-9943-cba8525f1fc1 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027116 Nov 16 15:57:04.760217 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: [pid: 101160|app: 0|req: 8/15] 10.222.0.46 () {64 vars in 1335 bytes} [Tue Nov 16 15:57:04 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 15:57:07.087205 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi [None req-6f1e2535-b676-4147-83e5-3c381572ca2f admin admin] Calling method '>' {{(pid=101159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 15:57:07.088259 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: INFO nova.api.openstack.requestlog [None req-6f1e2535-b676-4147-83e5-3c381572ca2f admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Nov 16 15:57:07.088674 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: [pid: 101159|app: 0|req: 8/16] 10.222.0.46 () {54 vars in 930 bytes} [Tue Nov 16 15:57:07 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 15:57:07.155572 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi [None req-67c94236-a679-4846-89d5-7626a6a4280f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d4", "vcpus": 4, "disk": 20, "name": "ds4G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "os-flavor-access:is_public": true}} {{(pid=101160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 15:57:07.175076 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: INFO nova.api.openstack.requestlog [None req-67c94236-a679-4846-89d5-7626a6a4280f admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077926 Nov 16 15:57:07.176027 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: [pid: 101160|app: 0|req: 9/17] 10.222.0.46 () {64 vars in 1282 bytes} [Tue Nov 16 15:57:07 2021] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 15:57:07.189004 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi [None req-1f83b674-3e99-49c6-8698-94e70b593cb0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 15:57:07.212771 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: INFO nova.api.openstack.requestlog [None req-1f83b674-3e99-49c6-8698-94e70b593cb0 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027528 Nov 16 15:57:07.213707 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: [pid: 101159|app: 0|req: 9/18] 10.222.0.46 () {64 vars in 1335 bytes} [Tue Nov 16 15:57:07 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 15:57:09.640794 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi [None req-67c94236-a679-4846-89d5-7626a6a4280f admin admin] Calling method '>' {{(pid=101160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 15:57:09.641853 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: INFO nova.api.openstack.requestlog [None req-67c94236-a679-4846-89d5-7626a6a4280f admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Nov 16 15:57:09.642250 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: [pid: 101160|app: 0|req: 10/19] 10.222.0.46 () {54 vars in 930 bytes} [Tue Nov 16 15:57:09 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 15:57:09.706639 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi [None req-4e578a16-d8cc-4fb8-a752-fa35bb48973c admin admin] Calling method '>' {{(pid=101159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 15:57:09.735555 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: INFO nova.api.openstack.requestlog [None req-4e578a16-d8cc-4fb8-a752-fa35bb48973c admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.086211 Nov 16 15:57:09.736182 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: [pid: 101159|app: 0|req: 10/20] 10.222.0.46 () {60 vars in 1291 bytes} [Tue Nov 16 15:57:09 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 15:57:12.051060 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi [None req-67c94236-a679-4846-89d5-7626a6a4280f admin admin] Calling method '>' {{(pid=101160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 15:57:12.052128 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: INFO nova.api.openstack.requestlog [None req-67c94236-a679-4846-89d5-7626a6a4280f admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Nov 16 15:57:12.052571 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: [pid: 101160|app: 0|req: 11/21] 10.222.0.46 () {54 vars in 930 bytes} [Tue Nov 16 15:57:12 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 15:57:12.116917 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi [None req-989427cb-a338-41e2-8497-cf90a80ed2f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.tiny", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "id": "1"}} {{(pid=101159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 15:57:12.138421 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: INFO nova.api.openstack.requestlog [None req-989427cb-a338-41e2-8497-cf90a80ed2f1 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.078278 Nov 16 15:57:12.138987 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: [pid: 101159|app: 0|req: 11/22] 10.222.0.46 () {64 vars in 1282 bytes} [Tue Nov 16 15:57:12 2021] POST /compute/v2.1/flavors => generated 402 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 15:57:12.152246 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi [None req-876bac06-ffb0-45bd-9367-15e5c2dd51f6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 15:57:12.177464 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: INFO nova.api.openstack.requestlog [None req-876bac06-ffb0-45bd-9367-15e5c2dd51f6 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029578 Nov 16 15:57:12.178957 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: [pid: 101160|app: 0|req: 12/23] 10.222.0.46 () {64 vars in 1332 bytes} [Tue Nov 16 15:57:12 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 15:57:14.748659 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi [None req-989427cb-a338-41e2-8497-cf90a80ed2f1 admin admin] Calling method '>' {{(pid=101159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 15:57:14.749874 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: INFO nova.api.openstack.requestlog [None req-989427cb-a338-41e2-8497-cf90a80ed2f1 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001693 Nov 16 15:57:14.750356 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: [pid: 101159|app: 0|req: 12/24] 10.222.0.46 () {54 vars in 930 bytes} [Tue Nov 16 15:57:14 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 15:57:14.813271 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi [None req-7e8e2ee4-c3f0-42d8-85bc-39a0ae456db8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "name": "m1.small", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "vcpus": 1, "disk": 20, "os-flavor-access:is_public": true}} {{(pid=101160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 15:57:14.845161 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: INFO nova.api.openstack.requestlog [None req-7e8e2ee4-c3f0-42d8-85bc-39a0ae456db8 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.086735 Nov 16 15:57:14.845958 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: [pid: 101160|app: 0|req: 13/25] 10.222.0.46 () {64 vars in 1282 bytes} [Tue Nov 16 15:57:14 2021] POST /compute/v2.1/flavors => generated 405 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 15:57:14.860200 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi [None req-7ebf50a8-398f-4121-84f2-b9191dd5b63f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 15:57:14.889640 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: INFO nova.api.openstack.requestlog [None req-7ebf50a8-398f-4121-84f2-b9191dd5b63f admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033018 Nov 16 15:57:14.890253 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: [pid: 101159|app: 0|req: 13/26] 10.222.0.46 () {64 vars in 1332 bytes} [Tue Nov 16 15:57:14 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 15:57:17.214953 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi [None req-7e8e2ee4-c3f0-42d8-85bc-39a0ae456db8 admin admin] Calling method '>' {{(pid=101160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 15:57:17.216145 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: INFO nova.api.openstack.requestlog [None req-7e8e2ee4-c3f0-42d8-85bc-39a0ae456db8 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002069 Nov 16 15:57:17.216555 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: [pid: 101160|app: 0|req: 14/27] 10.222.0.46 () {54 vars in 930 bytes} [Tue Nov 16 15:57:17 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 15:57:17.279092 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi [None req-f571205f-8301-48df-924b-ecd3d14f66e3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "ram": 4096, "disk": 40, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "vcpus": 2, "rxtx_factor": 1.0}} {{(pid=101159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 15:57:17.298758 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: INFO nova.api.openstack.requestlog [None req-f571205f-8301-48df-924b-ecd3d14f66e3 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.073731 Nov 16 15:57:17.299315 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: [pid: 101159|app: 0|req: 14/28] 10.222.0.46 () {64 vars in 1282 bytes} [Tue Nov 16 15:57:17 2021] POST /compute/v2.1/flavors => generated 406 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 15:57:17.311664 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi [None req-7ef45cc2-a75b-45f5-9399-13d5f859c7f5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 15:57:17.336785 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: INFO nova.api.openstack.requestlog [None req-7ef45cc2-a75b-45f5-9399-13d5f859c7f5 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028799 Nov 16 15:57:17.337355 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: [pid: 101160|app: 0|req: 15/29] 10.222.0.46 () {64 vars in 1332 bytes} [Tue Nov 16 15:57:17 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 15:57:19.727088 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi [None req-f571205f-8301-48df-924b-ecd3d14f66e3 admin admin] Calling method '>' {{(pid=101159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 15:57:19.728143 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: INFO nova.api.openstack.requestlog [None req-f571205f-8301-48df-924b-ecd3d14f66e3 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Nov 16 15:57:19.728739 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: [pid: 101159|app: 0|req: 15/30] 10.222.0.46 () {54 vars in 930 bytes} [Tue Nov 16 15:57:19 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 15:57:19.797145 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi [None req-c66b2263-2c97-45b1-8977-d2d1843cee35 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "name": "m1.large", "vcpus": 4, "ram": 8192, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0}} {{(pid=101160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 15:57:19.822434 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: INFO nova.api.openstack.requestlog [None req-c66b2263-2c97-45b1-8977-d2d1843cee35 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.085127 Nov 16 15:57:19.823884 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: [pid: 101160|app: 0|req: 16/31] 10.222.0.46 () {64 vars in 1282 bytes} [Tue Nov 16 15:57:19 2021] POST /compute/v2.1/flavors => generated 405 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 15:57:19.837636 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi [None req-501acae5-4bdb-4d4c-aac6-72efa1ed19d8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 15:57:19.864892 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: INFO nova.api.openstack.requestlog [None req-501acae5-4bdb-4d4c-aac6-72efa1ed19d8 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031343 Nov 16 15:57:19.868338 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: [pid: 101159|app: 0|req: 16/32] 10.222.0.46 () {64 vars in 1332 bytes} [Tue Nov 16 15:57:19 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 15:57:22.232876 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi [None req-c66b2263-2c97-45b1-8977-d2d1843cee35 admin admin] Calling method '>' {{(pid=101160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 15:57:22.234682 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: INFO nova.api.openstack.requestlog [None req-c66b2263-2c97-45b1-8977-d2d1843cee35 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002175 Nov 16 15:57:22.235394 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: [pid: 101160|app: 0|req: 17/33] 10.222.0.46 () {54 vars in 930 bytes} [Tue Nov 16 15:57:22 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 15:57:22.299361 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi [None req-72355629-550f-43b8-8345-4df3d0c7384c admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "ram": 16384, "name": "m1.xlarge", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "vcpus": 8, "id": "5"}} {{(pid=101159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 15:57:22.322237 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: INFO nova.api.openstack.requestlog [None req-72355629-550f-43b8-8345-4df3d0c7384c admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.080209 Nov 16 15:57:22.322802 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: [pid: 101159|app: 0|req: 17/34] 10.222.0.46 () {64 vars in 1282 bytes} [Tue Nov 16 15:57:22 2021] POST /compute/v2.1/flavors => generated 408 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 15:57:22.336991 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi [None req-a96da39a-595e-4f32-b719-f8ab48e0c83e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 15:57:22.362751 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: INFO nova.api.openstack.requestlog [None req-a96da39a-595e-4f32-b719-f8ab48e0c83e admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030002 Nov 16 15:57:22.363889 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: [pid: 101160|app: 0|req: 18/35] 10.222.0.46 () {64 vars in 1332 bytes} [Tue Nov 16 15:57:22 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 15:58:01.753798 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi [None req-72355629-550f-43b8-8345-4df3d0c7384c admin admin] Calling method '>' {{(pid=101159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 15:58:01.754843 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: INFO nova.api.openstack.requestlog [None req-72355629-550f-43b8-8345-4df3d0c7384c admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Nov 16 15:58:01.755253 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: [pid: 101159|app: 0|req: 18/36] 10.222.0.46 () {54 vars in 930 bytes} [Tue Nov 16 15:58:01 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 15:58:01.815269 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi [None req-ca4a24e8-148c-4332-ac6e-b0b3242ee53f admin admin] Calling method '>' {{(pid=101160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 15:58:01.832278 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: INFO nova.api.openstack.requestlog [None req-ca4a24e8-148c-4332-ac6e-b0b3242ee53f admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069704 Nov 16 15:58:01.832809 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: [pid: 101160|app: 0|req: 19/37] 10.222.0.46 () {60 vars in 1291 bytes} [Tue Nov 16 15:58:01 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 15:58:03.327607 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi [None req-72355629-550f-43b8-8345-4df3d0c7384c admin admin] Calling method '>' {{(pid=101159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 15:58:03.328622 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: INFO nova.api.openstack.requestlog [None req-72355629-550f-43b8-8345-4df3d0c7384c admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Nov 16 15:58:03.329026 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: [pid: 101159|app: 0|req: 19/38] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Nov 16 15:58:03 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 15:58:03.522839 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi [None req-ea69f252-ca16-4d98-bd35-971cc6614e52 admin admin] Calling method '>' {{(pid=101160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 15:58:03.529135 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: INFO nova.api.openstack.wsgi [None req-ea69f252-ca16-4d98-bd35-971cc6614e52 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 16 15:58:03.529706 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi [None req-ea69f252-ca16-4d98-bd35-971cc6614e52 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101160) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 15:58:03.530535 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: INFO nova.api.openstack.requestlog [None req-ea69f252-ca16-4d98-bd35-971cc6614e52 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.059856 Nov 16 15:58:03.531052 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: [pid: 101160|app: 0|req: 20/39] 10.222.0.46 () {60 vars in 1190 bytes} [Tue Nov 16 15:58:03 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 16 15:58:03.540848 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi [None req-2a86bc72-67db-4685-b03e-bab98852bab5 admin admin] Calling method '>' {{(pid=101159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 15:58:03.561421 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: INFO nova.api.openstack.requestlog [None req-2a86bc72-67db-4685-b03e-bab98852bab5 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024144 Nov 16 15:58:03.561960 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: [pid: 101159|app: 0|req: 20/40] 10.222.0.46 () {60 vars in 1210 bytes} [Tue Nov 16 15:58:03 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 15:58:03.571818 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi [None req-a0bc6a46-8917-4acf-a493-a38f94d5b1d5 admin admin] Calling method '>' {{(pid=101160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 15:58:03.593002 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: INFO nova.api.openstack.requestlog [None req-a0bc6a46-8917-4acf-a493-a38f94d5b1d5 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024611 Nov 16 15:58:03.593538 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: [pid: 101160|app: 0|req: 21/41] 10.222.0.46 () {60 vars in 1210 bytes} [Tue Nov 16 15:58:03 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 15:58:03.603378 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi [None req-ac0c1462-dd2d-4d20-beb9-d4494ace5fdf admin admin] Calling method '>' {{(pid=101159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 15:58:03.609422 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: INFO nova.api.openstack.wsgi [None req-ac0c1462-dd2d-4d20-beb9-d4494ace5fdf admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 16 15:58:03.609984 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi [None req-ac0c1462-dd2d-4d20-beb9-d4494ace5fdf admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101159) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 15:58:03.610772 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: INFO nova.api.openstack.requestlog [None req-ac0c1462-dd2d-4d20-beb9-d4494ace5fdf admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011022 Nov 16 15:58:03.611259 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: [pid: 101159|app: 0|req: 21/42] 10.222.0.46 () {60 vars in 1190 bytes} [Tue Nov 16 15:58:03 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 16 15:58:05.001660 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi [None req-a0bc6a46-8917-4acf-a493-a38f94d5b1d5 admin admin] Calling method '>' {{(pid=101160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 15:58:05.002656 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: INFO nova.api.openstack.requestlog [None req-a0bc6a46-8917-4acf-a493-a38f94d5b1d5 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Nov 16 15:58:05.003098 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: [pid: 101160|app: 0|req: 22/43] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Nov 16 15:58:05 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 15:58:05.194363 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi [None req-892d22c8-de88-4713-879e-24864ad1a58c admin admin] Calling method '>' {{(pid=101159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 15:58:05.201003 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: INFO nova.api.openstack.wsgi [None req-892d22c8-de88-4713-879e-24864ad1a58c admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 16 15:58:05.201564 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi [None req-892d22c8-de88-4713-879e-24864ad1a58c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101159) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 15:58:05.202351 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: INFO nova.api.openstack.requestlog [None req-892d22c8-de88-4713-879e-24864ad1a58c admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058848 Nov 16 15:58:05.202854 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: [pid: 101159|app: 0|req: 22/44] 10.222.0.46 () {60 vars in 1190 bytes} [Tue Nov 16 15:58:05 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 16 15:58:05.212588 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi [None req-fe41ef88-7a56-4e05-9050-c7af20f7cb53 admin admin] Calling method '>' {{(pid=101160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 15:58:05.225888 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: INFO nova.api.openstack.requestlog [None req-fe41ef88-7a56-4e05-9050-c7af20f7cb53 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016859 Nov 16 15:58:05.226464 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: [pid: 101160|app: 0|req: 23/45] 10.222.0.46 () {60 vars in 1210 bytes} [Tue Nov 16 15:58:05 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 15:58:05.237070 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi [None req-7e59ca7c-9ed0-4e3b-95ef-dfe6a438a3ad admin admin] Calling method '>' {{(pid=101159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 15:58:05.251207 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: INFO nova.api.openstack.requestlog [None req-7e59ca7c-9ed0-4e3b-95ef-dfe6a438a3ad admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017722 Nov 16 15:58:05.251767 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: [pid: 101159|app: 0|req: 23/46] 10.222.0.46 () {60 vars in 1210 bytes} [Tue Nov 16 15:58:05 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 15:58:05.261442 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi [None req-9b48a663-6ae6-49eb-98d8-99241c150596 admin admin] Calling method '>' {{(pid=101160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 15:58:05.266539 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: INFO nova.api.openstack.wsgi [None req-9b48a663-6ae6-49eb-98d8-99241c150596 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 16 15:58:05.267103 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi [None req-9b48a663-6ae6-49eb-98d8-99241c150596 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101160) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 15:58:05.267934 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: INFO nova.api.openstack.requestlog [None req-9b48a663-6ae6-49eb-98d8-99241c150596 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010133 Nov 16 15:58:05.268427 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: [pid: 101160|app: 0|req: 24/47] 10.222.0.46 () {60 vars in 1190 bytes} [Tue Nov 16 15:58:05 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 16 15:58:06.653871 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi [None req-7e59ca7c-9ed0-4e3b-95ef-dfe6a438a3ad admin admin] Calling method '>' {{(pid=101159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 15:58:06.654885 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: INFO nova.api.openstack.requestlog [None req-7e59ca7c-9ed0-4e3b-95ef-dfe6a438a3ad admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Nov 16 15:58:06.655323 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: [pid: 101159|app: 0|req: 24/48] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Nov 16 15:58:06 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 15:58:06.847106 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi [None req-355ff32b-f185-4332-a18b-0b110881fca2 admin admin] Calling method '>' {{(pid=101160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 15:58:06.852272 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: INFO nova.api.openstack.wsgi [None req-355ff32b-f185-4332-a18b-0b110881fca2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 16 15:58:06.852823 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi [None req-355ff32b-f185-4332-a18b-0b110881fca2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101160) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 15:58:06.853602 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: INFO nova.api.openstack.requestlog [None req-355ff32b-f185-4332-a18b-0b110881fca2 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057564 Nov 16 15:58:06.854101 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: [pid: 101160|app: 0|req: 25/49] 10.222.0.46 () {60 vars in 1193 bytes} [Tue Nov 16 15:58:06 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 16 15:58:06.864428 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi [None req-ee4ed4e4-7a78-432d-bdae-8645b2aaf937 admin admin] Calling method '>' {{(pid=101159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 15:58:06.878253 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: INFO nova.api.openstack.requestlog [None req-ee4ed4e4-7a78-432d-bdae-8645b2aaf937 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017323 Nov 16 15:58:06.878782 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: [pid: 101159|app: 0|req: 25/50] 10.222.0.46 () {60 vars in 1210 bytes} [Tue Nov 16 15:58:06 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 15:58:06.889246 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi [None req-276b63ba-8d3d-4869-a8b3-a388151aaf31 admin admin] Calling method '>' {{(pid=101160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 15:58:06.902438 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: INFO nova.api.openstack.requestlog [None req-276b63ba-8d3d-4869-a8b3-a388151aaf31 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017223 Nov 16 15:58:06.902962 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: [pid: 101160|app: 0|req: 26/51] 10.222.0.46 () {60 vars in 1210 bytes} [Tue Nov 16 15:58:06 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 15:58:06.912510 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi [None req-96659350-74ac-4af4-8e5f-f2a65cbfe1a4 admin admin] Calling method '>' {{(pid=101159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 15:58:06.918250 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: INFO nova.api.openstack.wsgi [None req-96659350-74ac-4af4-8e5f-f2a65cbfe1a4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 16 15:58:06.918953 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi [None req-96659350-74ac-4af4-8e5f-f2a65cbfe1a4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101159) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 15:58:06.919780 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: INFO nova.api.openstack.requestlog [None req-96659350-74ac-4af4-8e5f-f2a65cbfe1a4 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010720 Nov 16 15:58:06.920282 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: [pid: 101159|app: 0|req: 26/52] 10.222.0.46 () {60 vars in 1193 bytes} [Tue Nov 16 15:58:06 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 16 15:58:08.324016 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi [None req-276b63ba-8d3d-4869-a8b3-a388151aaf31 admin admin] Calling method '>' {{(pid=101160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 15:58:08.325016 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: INFO nova.api.openstack.requestlog [None req-276b63ba-8d3d-4869-a8b3-a388151aaf31 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001997 Nov 16 15:58:08.325415 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: [pid: 101160|app: 0|req: 27/53] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Nov 16 15:58:08 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 15:58:08.520439 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi [None req-b883fb6b-4b3e-4577-9250-8d22247a7598 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 15:58:08.538768 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: INFO nova.api.openstack.requestlog [None req-b883fb6b-4b3e-4577-9250-8d22247a7598 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.069579 Nov 16 15:58:08.539245 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: [pid: 101159|app: 0|req: 27/54] 10.222.0.46 () {64 vars in 1235 bytes} [Tue Nov 16 15:58:08 2021] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 15:58:09.949280 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi [None req-276b63ba-8d3d-4869-a8b3-a388151aaf31 admin admin] Calling method '>' {{(pid=101160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 15:58:09.950421 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: INFO nova.api.openstack.requestlog [None req-276b63ba-8d3d-4869-a8b3-a388151aaf31 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002155 Nov 16 15:58:09.950845 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: [pid: 101160|app: 0|req: 28/55] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Nov 16 15:58:09 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 15:58:10.141874 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi [None req-4dcb4e29-4a63-4c5d-b8d9-c9f060ca14ab admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 15:58:10.160116 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: INFO nova.api.openstack.requestlog [None req-4dcb4e29-4a63-4c5d-b8d9-c9f060ca14ab admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.069331 Nov 16 15:58:10.160648 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: [pid: 101159|app: 0|req: 28/56] 10.222.0.46 () {64 vars in 1235 bytes} [Tue Nov 16 15:58:10 2021] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 15:58:11.576606 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi [None req-276b63ba-8d3d-4869-a8b3-a388151aaf31 admin admin] Calling method '>' {{(pid=101160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 15:58:11.577632 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: INFO nova.api.openstack.requestlog [None req-276b63ba-8d3d-4869-a8b3-a388151aaf31 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Nov 16 15:58:11.578028 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: [pid: 101160|app: 0|req: 29/57] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Nov 16 15:58:11 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 15:58:11.772657 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi [None req-5ec80cc1-7c38-47f3-a6ac-35918dee04f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 15:58:11.791286 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: INFO nova.api.openstack.requestlog [None req-5ec80cc1-7c38-47f3-a6ac-35918dee04f0 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.070863 Nov 16 15:58:11.791792 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: [pid: 101159|app: 0|req: 29/58] 10.222.0.46 () {64 vars in 1235 bytes} [Tue Nov 16 15:58:11 2021] POST /compute/v2.1/flavors => generated 407 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 15:58:13.169758 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi [None req-276b63ba-8d3d-4869-a8b3-a388151aaf31 admin admin] Calling method '>' {{(pid=101160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 15:58:13.170754 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: INFO nova.api.openstack.requestlog [None req-276b63ba-8d3d-4869-a8b3-a388151aaf31 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Nov 16 15:58:13.171147 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: [pid: 101160|app: 0|req: 30/59] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Nov 16 15:58:13 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 15:58:13.361694 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi [None req-ece5c13c-f56b-4e37-83c6-805a52d2f85d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 15:58:13.379846 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: INFO nova.api.openstack.requestlog [None req-ece5c13c-f56b-4e37-83c6-805a52d2f85d admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069035 Nov 16 15:58:13.380329 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: [pid: 101159|app: 0|req: 30/60] 10.222.0.46 () {64 vars in 1235 bytes} [Tue Nov 16 15:58:13 2021] POST /compute/v2.1/flavors => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 15:58:14.759188 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi [None req-276b63ba-8d3d-4869-a8b3-a388151aaf31 admin admin] Calling method '>' {{(pid=101160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 15:58:14.760200 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: INFO nova.api.openstack.requestlog [None req-276b63ba-8d3d-4869-a8b3-a388151aaf31 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Nov 16 15:58:14.760591 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: [pid: 101160|app: 0|req: 31/61] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Nov 16 15:58:14 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 15:58:14.954679 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi [None req-dbe5f600-b02d-4e1f-adf3-9b6e9f1f56a4 admin admin] Calling method '>' {{(pid=101159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 15:58:14.974520 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: INFO nova.api.openstack.requestlog [None req-dbe5f600-b02d-4e1f-adf3-9b6e9f1f56a4 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071093 Nov 16 15:58:14.974977 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: [pid: 101159|app: 0|req: 31/62] 10.222.0.46 () {60 vars in 1202 bytes} [Tue Nov 16 15:58:14 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 15:59:01.871069 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi [None req-276b63ba-8d3d-4869-a8b3-a388151aaf31 admin admin] Calling method '>' {{(pid=101160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 15:59:01.872346 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: INFO nova.api.openstack.requestlog [None req-276b63ba-8d3d-4869-a8b3-a388151aaf31 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001672 Nov 16 15:59:01.872756 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: [pid: 101160|app: 0|req: 32/63] 10.222.0.46 () {54 vars in 930 bytes} [Tue Nov 16 15:59:01 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 15:59:01.943268 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi [None req-37c391ae-2b0c-41ea-9798-c6db6e6a2040 admin admin] Calling method '>' {{(pid=101159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 15:59:01.963566 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: INFO nova.api.openstack.requestlog [None req-37c391ae-2b0c-41ea-9798-c6db6e6a2040 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.082671 Nov 16 15:59:01.964116 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: [pid: 101159|app: 0|req: 32/64] 10.222.0.46 () {60 vars in 1291 bytes} [Tue Nov 16 15:59:01 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 15:59:01.994181 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi [None req-f9b58aa7-c75f-449e-aa19-7fcd5bcd1d85 admin admin] Calling method '>' {{(pid=101160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 15:59:02.005907 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: INFO nova.api.openstack.requestlog [None req-f9b58aa7-c75f-449e-aa19-7fcd5bcd1d85 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015424 Nov 16 15:59:02.006460 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: [pid: 101160|app: 0|req: 33/65] 10.222.0.46 () {60 vars in 1282 bytes} [Tue Nov 16 15:59:01 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 15:59:02.020502 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi [None req-6e14d393-771e-48e8-a956-a4b0def819c5 admin admin] Calling method '>' {{(pid=101159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 15:59:02.031065 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: INFO nova.api.openstack.requestlog [None req-6e14d393-771e-48e8-a956-a4b0def819c5 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013826 Nov 16 15:59:02.031802 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: [pid: 101159|app: 0|req: 33/66] 10.222.0.46 () {60 vars in 1285 bytes} [Tue Nov 16 15:59:02 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 15:59:02.046320 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi [None req-1fc4e254-d216-4015-9055-5baa40a7e873 admin admin] Calling method '>' {{(pid=101160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 15:59:02.056611 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: INFO nova.api.openstack.requestlog [None req-1fc4e254-d216-4015-9055-5baa40a7e873 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014752 Nov 16 15:59:02.057234 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: [pid: 101160|app: 0|req: 34/67] 10.222.0.46 () {60 vars in 1285 bytes} [Tue Nov 16 15:59:02 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 15:59:02.073121 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi [None req-9a6a1590-0132-4924-8b40-124a4c9c28bb admin admin] Calling method '>' {{(pid=101159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 15:59:02.083335 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: INFO nova.api.openstack.requestlog [None req-9a6a1590-0132-4924-8b40-124a4c9c28bb admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016123 Nov 16 15:59:02.083930 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: [pid: 101159|app: 0|req: 34/68] 10.222.0.46 () {60 vars in 1282 bytes} [Tue Nov 16 15:59:02 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:00:25.226772 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi [None req-1af6afd0-1b35-4759-b38d-579c4f578899 tempest-verify_tempest_config-1367289443 tempest-verify_tempest_config-1367289443-project] Calling method '>' {{(pid=101160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:00:25.228985 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: INFO nova.api.openstack.requestlog [None req-1af6afd0-1b35-4759-b38d-579c4f578899 tempest-verify_tempest_config-1367289443 tempest-verify_tempest_config-1367289443-project] 10.222.0.46 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.105516 Nov 16 16:00:25.229574 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: [pid: 101160|app: 0|req: 35/69] 10.222.0.46 () {58 vars in 1133 bytes} [Tue Nov 16 16:00:25 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:01:52.004958 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi [None req-9a6a1590-0132-4924-8b40-124a4c9c28bb admin admin] Calling method '>' {{(pid=101159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:01:52.005963 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: INFO nova.api.openstack.requestlog [None req-9a6a1590-0132-4924-8b40-124a4c9c28bb admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Nov 16 16:01:52.006357 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: [pid: 101159|app: 0|req: 35/70] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Nov 16 16:01:52 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:01:52.260724 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi [None req-36001b8d-fa12-4c04-b9bd-11a94a34a2e3 admin admin] Calling method '>' {{(pid=101160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:01:52.262189 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:01:52.262189 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: warnings.warn(msg) Nov 16 16:01:52.263744 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG oslo_concurrency.lockutils [None req-36001b8d-fa12-4c04-b9bd-11a94a34a2e3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:01:52.264791 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG oslo_concurrency.lockutils [None req-36001b8d-fa12-4c04-b9bd-11a94a34a2e3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:01:52.266006 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG oslo_concurrency.lockutils [None req-36001b8d-fa12-4c04-b9bd-11a94a34a2e3 admin admin] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:01:52.266426 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG oslo_concurrency.lockutils [None req-36001b8d-fa12-4c04-b9bd-11a94a34a2e3 admin admin] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:01:52.299946 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: INFO nova.api.openstack.requestlog [None req-36001b8d-fa12-4c04-b9bd-11a94a34a2e3 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.149965 Nov 16 16:01:52.300492 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: [pid: 101160|app: 0|req: 36/71] 10.222.0.46 () {60 vars in 1193 bytes} [Tue Nov 16 16:01:52 2021] GET /compute/v2.1/os-services => generated 791 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:01:53.730657 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi [None req-9a6a1590-0132-4924-8b40-124a4c9c28bb admin admin] Calling method '>' {{(pid=101159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:01:53.732357 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: INFO nova.api.openstack.requestlog [None req-9a6a1590-0132-4924-8b40-124a4c9c28bb admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002148 Nov 16 16:01:53.733012 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: [pid: 101159|app: 0|req: 36/72] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Nov 16 16:01:53 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:01:53.929958 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi [None req-b2db015a-a78a-4bd7-b7a3-a9daad75e4a3 admin admin] Calling method '>' {{(pid=101160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:01:53.931103 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:01:53.931103 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: warnings.warn(msg) Nov 16 16:01:53.932669 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG oslo_concurrency.lockutils [None req-b2db015a-a78a-4bd7-b7a3-a9daad75e4a3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:01:53.933101 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG oslo_concurrency.lockutils [None req-b2db015a-a78a-4bd7-b7a3-a9daad75e4a3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:01:53.933887 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG oslo_concurrency.lockutils [None req-b2db015a-a78a-4bd7-b7a3-a9daad75e4a3 admin admin] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:01:53.934301 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG oslo_concurrency.lockutils [None req-b2db015a-a78a-4bd7-b7a3-a9daad75e4a3 admin admin] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:01:53.959638 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: INFO nova.api.openstack.requestlog [None req-b2db015a-a78a-4bd7-b7a3-a9daad75e4a3 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.080302 Nov 16 16:01:53.960114 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: [pid: 101160|app: 0|req: 37/73] 10.222.0.46 () {60 vars in 1193 bytes} [Tue Nov 16 16:01:53 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:02:05.801102 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi [None req-9a6a1590-0132-4924-8b40-124a4c9c28bb admin admin] Calling method '>' {{(pid=101159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:02:05.802094 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: INFO nova.api.openstack.requestlog [None req-9a6a1590-0132-4924-8b40-124a4c9c28bb admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Nov 16 16:02:05.802494 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: [pid: 101159|app: 0|req: 37/74] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Nov 16 16:02:05 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:02:05.995747 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi [None req-e35baab8-1277-43d5-a582-92a023097270 admin admin] Calling method '>' {{(pid=101160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:02:05.996909 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:02:05.996909 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: warnings.warn(msg) Nov 16 16:02:05.998424 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG oslo_concurrency.lockutils [None req-e35baab8-1277-43d5-a582-92a023097270 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:02:05.998856 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG oslo_concurrency.lockutils [None req-e35baab8-1277-43d5-a582-92a023097270 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:02:05.999661 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG oslo_concurrency.lockutils [None req-e35baab8-1277-43d5-a582-92a023097270 admin admin] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:02:06.000083 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG oslo_concurrency.lockutils [None req-e35baab8-1277-43d5-a582-92a023097270 admin admin] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:02:06.021805 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: INFO nova.api.openstack.requestlog [None req-e35baab8-1277-43d5-a582-92a023097270 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077121 Nov 16 16:02:06.022368 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: [pid: 101160|app: 0|req: 38/75] 10.222.0.46 () {60 vars in 1193 bytes} [Tue Nov 16 16:02:05 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:02:07.433303 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: DEBUG nova.api.openstack.wsgi [None req-9a6a1590-0132-4924-8b40-124a4c9c28bb admin admin] Calling method '>' {{(pid=101159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:02:07.434391 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: INFO nova.api.openstack.requestlog [None req-9a6a1590-0132-4924-8b40-124a4c9c28bb admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Nov 16 16:02:07.434846 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: [pid: 101159|app: 0|req: 38/76] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Nov 16 16:02:07 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:02:07.634122 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG nova.api.openstack.wsgi [None req-34f480e9-892b-477c-b2c0-cf47eec06bff admin admin] Calling method '>' {{(pid=101160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:02:07.635278 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:02:07.635278 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: warnings.warn(msg) Nov 16 16:02:07.636973 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG oslo_concurrency.lockutils [None req-34f480e9-892b-477c-b2c0-cf47eec06bff admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:02:07.637415 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG oslo_concurrency.lockutils [None req-34f480e9-892b-477c-b2c0-cf47eec06bff admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:02:07.638207 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG oslo_concurrency.lockutils [None req-34f480e9-892b-477c-b2c0-cf47eec06bff admin admin] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:02:07.638633 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: DEBUG oslo_concurrency.lockutils [None req-34f480e9-892b-477c-b2c0-cf47eec06bff admin admin] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:02:07.660546 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: INFO nova.api.openstack.requestlog [None req-34f480e9-892b-477c-b2c0-cf47eec06bff admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.080681 Nov 16 16:02:07.661032 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: [pid: 101160|app: 0|req: 39/77] 10.222.0.46 () {60 vars in 1193 bytes} [Tue Nov 16 16:02:07 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:03:04.820222 dv-cinder-818098-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Nov 16 16:03:04.820764 dv-cinder-818098-2-iscsi devstack@n-api.service[101158]: Tue Nov 16 16:03:04 2021 - graceful shutdown triggered... Nov 16 16:03:04.821244 dv-cinder-818098-2-iscsi devstack@n-api.service[101159]: Gracefully killing worker 1 (pid: 101159)... Nov 16 16:03:04.822171 dv-cinder-818098-2-iscsi devstack@n-api.service[101160]: Gracefully killing worker 2 (pid: 101160)... Nov 16 16:03:05.820898 dv-cinder-818098-2-iscsi devstack@n-api.service[101158]: worker 1 buried after 1 seconds Nov 16 16:03:05.821373 dv-cinder-818098-2-iscsi devstack@n-api.service[101158]: worker 2 buried after 1 seconds Nov 16 16:03:05.821373 dv-cinder-818098-2-iscsi devstack@n-api.service[101158]: goodbye to uWSGI. Nov 16 16:03:05.822496 dv-cinder-818098-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Nov 16 16:03:05.823045 dv-cinder-818098-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Nov 16 16:03:05.825873 dv-cinder-818098-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 16 16:03:05.837110 dv-cinder-818098-2-iscsi devstack@n-api.service[116061]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 16 16:03:05.839173 dv-cinder-818098-2-iscsi devstack@n-api.service[116061]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Nov 16 16:03:05 2021] *** Nov 16 16:03:05.839173 dv-cinder-818098-2-iscsi devstack@n-api.service[116061]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 16 16:03:05.839173 dv-cinder-818098-2-iscsi devstack@n-api.service[116061]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 16 16:03:05.839173 dv-cinder-818098-2-iscsi devstack@n-api.service[116061]: nodename: dv-cinder-818098-2-iscsi Nov 16 16:03:05.839173 dv-cinder-818098-2-iscsi devstack@n-api.service[116061]: machine: x86_64 Nov 16 16:03:05.839173 dv-cinder-818098-2-iscsi devstack@n-api.service[116061]: clock source: unix Nov 16 16:03:05.839173 dv-cinder-818098-2-iscsi devstack@n-api.service[116061]: pcre jit disabled Nov 16 16:03:05.839173 dv-cinder-818098-2-iscsi devstack@n-api.service[116061]: detected number of CPU cores: 4 Nov 16 16:03:05.839173 dv-cinder-818098-2-iscsi devstack@n-api.service[116061]: current working directory: / Nov 16 16:03:05.839173 dv-cinder-818098-2-iscsi devstack@n-api.service[116061]: detected binary path: /usr/bin/uwsgi-core Nov 16 16:03:05.839998 dv-cinder-818098-2-iscsi devstack@n-api.service[116061]: your processes number limit is 47680 Nov 16 16:03:05.839998 dv-cinder-818098-2-iscsi devstack@n-api.service[116061]: your memory page size is 4096 bytes Nov 16 16:03:05.839998 dv-cinder-818098-2-iscsi devstack@n-api.service[116061]: detected max file descriptor number: 2048 Nov 16 16:03:05.839998 dv-cinder-818098-2-iscsi devstack@n-api.service[116061]: lock engine: pthread robust mutexes Nov 16 16:03:05.839998 dv-cinder-818098-2-iscsi devstack@n-api.service[116061]: thunder lock: enabled Nov 16 16:03:05.839998 dv-cinder-818098-2-iscsi devstack@n-api.service[116061]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 16 16:03:05.839998 dv-cinder-818098-2-iscsi devstack@n-api.service[116061]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 16 16:03:05.887142 dv-cinder-818098-2-iscsi devstack@n-api.service[116061]: Python main interpreter initialized at 0x5582641369c0 Nov 16 16:03:05.887142 dv-cinder-818098-2-iscsi devstack@n-api.service[116061]: python threads support enabled Nov 16 16:03:05.887142 dv-cinder-818098-2-iscsi devstack@n-api.service[116061]: your server socket listen backlog is limited to 100 connections Nov 16 16:03:05.887142 dv-cinder-818098-2-iscsi devstack@n-api.service[116061]: your mercy for graceful operations on workers is 90 seconds Nov 16 16:03:05.889637 dv-cinder-818098-2-iscsi devstack@n-api.service[116061]: mapped 403077 bytes (393 KB) for 2 cores Nov 16 16:03:05.889804 dv-cinder-818098-2-iscsi devstack@n-api.service[116061]: *** Operational MODE: preforking *** Nov 16 16:03:05.890170 dv-cinder-818098-2-iscsi devstack@n-api.service[116061]: *** uWSGI is running in multiple interpreter mode *** Nov 16 16:03:05.890170 dv-cinder-818098-2-iscsi devstack@n-api.service[116061]: spawned uWSGI master process (pid: 116061) Nov 16 16:03:05.890380 dv-cinder-818098-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 16 16:03:05.891062 dv-cinder-818098-2-iscsi devstack@n-api.service[116061]: spawned uWSGI worker 1 (pid: 116084, cores: 1) Nov 16 16:03:05.891422 dv-cinder-818098-2-iscsi devstack@n-api.service[116061]: spawned uWSGI worker 2 (pid: 116085, cores: 1) Nov 16 16:03:05.891638 dv-cinder-818098-2-iscsi devstack@n-api.service[116061]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 16 16:03:07.652522 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 16 16:03:07.652522 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: from cryptography.utils import int_from_bytes Nov 16 16:03:07.653508 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 16 16:03:07.653508 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: from cryptography.utils import int_from_bytes Nov 16 16:03:07.677951 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 16 16:03:07.677951 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: from cryptography.utils import int_from_bytes Nov 16 16:03:07.678613 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 16 16:03:07.678613 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: from cryptography.utils import int_from_bytes Nov 16 16:03:10.026768 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 16 16:03:10.027981 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 16 16:03:10.027981 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 16 16:03:10.028174 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 16 16:03:10.028553 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 16 16:03:10.028659 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 16 16:03:10.028751 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 16 16:03:10.028827 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.029120 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.029232 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 16 16:03:10.029453 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.029566 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 16 16:03:10.029782 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.029953 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 16 16:03:10.030138 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.030434 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.030609 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.030768 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.030895 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.031089 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.031256 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.031426 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.031692 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.031795 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.031949 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.032051 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.032231 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.032363 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818098-2-iscsi {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.032564 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.032667 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.032895 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.032999 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.033232 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.033395 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.033576 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.033759 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.033940 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.034088 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.034265 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818098-2-iscsi {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.034488 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.034643 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.034798 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.034951 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.035892 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.036094 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.036094 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.036094 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.037293 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.037293 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.038038 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.038038 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.038800 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.039254 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.039611 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.039876 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.040108 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.040331 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.040774 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.041183 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.041716 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.042178 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.042630 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.042793 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.043569 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.043767 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.043932 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.044392 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.045133 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.045133 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.045434 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818098-2-iscsi {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.045646 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.045884 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.046050 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818098-2-iscsi {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.046207 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.046207 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.046588 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.046588 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.046877 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.047030 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.047186 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.047186 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.047499 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.047719 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.047901 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.048056 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.048871 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.048979 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.049102 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.049207 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.049320 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.049457 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.049598 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.049750 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.049875 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.049875 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.050011 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.050092 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.050219 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.050312 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.050401 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.050473 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.050544 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.050623 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.050701 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.050778 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.050861 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.050974 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.051063 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.051134 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.051214 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.051302 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.051380 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.051457 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.051582 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.051688 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.051763 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.051853 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.051928 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.052030 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.052110 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.052110 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.052286 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.052365 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.052446 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.052524 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.052605 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.052684 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.052835 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.052911 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.052987 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.053059 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.053128 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.053207 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.053207 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.053348 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.053420 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.053495 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.053576 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.053662 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.053741 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.053813 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.053813 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.053945 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.054026 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.054111 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.054184 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.054253 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.054331 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.054414 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.054492 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.054584 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.054663 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.054735 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.054811 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.054883 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.054961 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.055032 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.055178 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.055253 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.055332 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.055403 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.055503 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.055591 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.055665 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.055743 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.055821 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.055900 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.055981 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.056053 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.056130 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.056208 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.056448 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.056546 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.056650 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.056731 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.056804 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.057952 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.058110 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.058264 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.058415 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.058564 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.058564 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.058894 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.059044 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.059044 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.059327 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.059498 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.059649 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.059807 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.059950 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.060101 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.060250 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.060394 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.060534 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.060692 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.060837 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.060998 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.061148 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.061291 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.061432 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.061582 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.061724 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.061884 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.062028 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.062168 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.062309 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.062450 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.062619 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.062762 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.062911 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.063053 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.063195 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.063344 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.063519 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.063519 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.063814 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.063968 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.064110 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.064110 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.064397 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.064550 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.065196 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.065357 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.065581 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.065827 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.066067 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.066279 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.066438 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.066582 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.066724 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.066900 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.066900 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.067347 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.067631 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.067858 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.068089 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.068352 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.068520 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.068664 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.068808 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.068950 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.069092 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.069244 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.069393 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.069393 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.069677 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.069830 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.069980 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.070124 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.070278 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.070429 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.070572 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.070713 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.070862 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.071005 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.071159 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.071311 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.071538 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.071784 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.072047 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.072210 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.072372 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.072522 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.072664 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.072816 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.072990 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.073165 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.073165 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.073436 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.073579 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.073579 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.073907 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.074055 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.074203 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.074345 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.074498 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.074654 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.074827 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.074970 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.074970 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.075245 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.075424 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.075596 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.075738 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.075904 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.076060 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.076060 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.076338 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.076481 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.076481 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.076763 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.076905 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.077054 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.077205 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.077355 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:03:10.077497 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.077664 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.077808 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.077963 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.078106 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.078247 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.078395 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.078537 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.078685 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.078843 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.078987 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.079127 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.079268 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.079419 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.079617 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.079774 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.079923 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.080074 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.080216 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.080410 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.081213 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.081423 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.081632 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.081877 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.082094 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.082326 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.082566 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.082566 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.082871 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.083024 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.083167 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.083167 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.083436 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.083436 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.083787 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.083931 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.084081 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.084231 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.084374 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.084538 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.084690 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.084834 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.084985 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.085127 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.085269 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.085424 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.085567 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.085764 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.085915 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.086089 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.086248 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.086443 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.086605 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.086778 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.086926 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.087078 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.087239 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.087383 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.087563 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.087711 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.087853 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.088022 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.088194 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.088338 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.088488 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.088673 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.088834 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.088985 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.089142 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.089320 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.089470 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.089620 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.089763 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.089939 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.090131 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.090276 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.090427 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.090588 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.090731 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.090882 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.091243 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.091515 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.091759 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.091973 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.092198 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.092435 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.092661 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.092877 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.093101 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.093323 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.093550 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.093776 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.093984 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.094206 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.094426 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.094644 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.094860 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.095091 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.095318 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.095565 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.095776 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.096011 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.096218 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.096460 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.096673 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.096883 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.097091 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.097305 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.097526 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.097746 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.097963 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.098181 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.098401 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.098627 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.098857 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.099063 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.099295 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.099588 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.099813 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.100051 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.100275 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.100488 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.100713 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.100925 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.101142 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.101387 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.101721 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.101947 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.102177 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.102399 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.102621 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.102955 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.102955 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.103372 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.103626 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.103842 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.104073 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.104305 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.104524 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.104743 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.104973 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.105210 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.105423 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.105653 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.105861 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.106073 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.106293 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.106513 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.106729 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.106962 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.107181 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.107406 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.107678 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.107904 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.108149 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.108373 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.108593 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.108803 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.109025 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.109238 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.109465 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.109465 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.109891 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.110113 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.110337 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.110553 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.110780 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.111645 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.111987 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.112231 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.112464 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.112686 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.112913 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.113126 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.113348 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.113560 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.113775 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.114023 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.114259 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.115690 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.115854 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.116012 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.116168 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.116313 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.116467 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.116620 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.116764 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.116926 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.117071 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.117215 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.117357 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.117521 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.117680 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.117831 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.117982 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.118125 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.118274 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.118417 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.118574 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.118726 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.118878 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.119029 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.119029 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.119308 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.119514 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.119679 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.119831 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.119981 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.120123 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.120272 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.120272 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.120558 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.120710 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.120860 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.121030 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.121383 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.121548 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.121705 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.121855 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.122105 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.122254 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.122405 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.122549 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.122700 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.122842 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.122993 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.123135 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.123297 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.123448 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.123626 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.123784 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.123933 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.124075 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.124230 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.124373 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.124373 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.124659 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.124811 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.124811 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.125089 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.125239 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.125382 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.125531 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.125691 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.125854 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.126003 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.126151 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.126299 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.126454 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.126611 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.126774 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.126924 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.127079 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.127789 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.127976 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.128232 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.128506 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.128744 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.129000 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.129155 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.129305 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.129455 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.129618 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.129778 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.129928 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.130104 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.130266 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.130428 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.130590 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.130747 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.130897 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.131054 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.131204 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.131400 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.131617 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.131811 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.131977 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.132278 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.132424 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.132600 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.132729 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.132899 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.133021 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.133177 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.133329 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.133487 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.133665 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.133840 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.133938 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.134033 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.134154 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.134269 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.134357 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.134477 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.134591 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.134680 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.134810 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.134915 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.135009 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.135120 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.135231 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.135316 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.135428 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.135664 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.135807 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.135918 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.136014 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.136107 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.136203 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.136350 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.136488 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.136620 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.136754 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.136887 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.137097 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.137189 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.137274 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.137367 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.137459 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.137553 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.137639 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.137639 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.137790 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.137882 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.138014 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.138149 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.138239 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.138331 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.138331 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.138499 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.138584 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.138676 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.138762 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.138762 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.138931 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.139016 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.139098 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.139191 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.139283 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.139376 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.139376 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.139576 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.139673 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.139749 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.139839 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.139839 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.139990 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.140081 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.140081 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.140250 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.140390 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.140488 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.140622 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.140715 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.140809 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.140809 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.140971 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.141071 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.141156 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.141248 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.141342 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.141435 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.141520 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.141603 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.141698 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.141835 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.141933 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.142025 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.142117 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.142202 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.142356 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.142457 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.142552 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.142637 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.142799 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.142924 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.142924 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.143810 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.143981 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.143981 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.144276 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.144376 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.144376 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.144530 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.144613 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.144704 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.144802 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.144802 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.144992 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.145082 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.145166 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.145257 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.145355 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.145448 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.145539 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.145624 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.145624 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.145805 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.145907 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.145907 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.146061 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.146152 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.146244 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.146337 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.146422 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.146607 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.146935 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.147047 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.147234 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.147487 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.147598 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.147881 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.148019 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.148202 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.148516 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.148616 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.148837 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.149101 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.149213 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.149461 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.149648 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.149781 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.150095 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.150186 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.150444 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.150722 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.150856 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.151042 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.151267 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.151367 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.151679 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.151853 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.151993 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.152317 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.152430 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.152886 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.153200 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.153290 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.153517 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.153775 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.153868 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.154136 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.154325 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.154448 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.154758 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.154886 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.155071 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.155388 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.155630 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.155755 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.156012 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.156114 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.157083 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.157290 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.157399 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.157399 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.157399 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.157631 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.157706 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.157971 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.158074 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.158375 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.158702 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.158839 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.158993 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.159146 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.159268 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.159435 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.159556 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.159809 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.159901 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.160147 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.160234 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.160464 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.160561 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.160784 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.160892 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.161098 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.161189 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.161417 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.161498 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.161731 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.161897 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.162046 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.162134 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.162363 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.162453 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.162677 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.162766 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.162989 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.163077 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.163321 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.163410 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.163665 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.163796 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.163981 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.164063 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.164296 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.164384 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.164663 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.164761 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.165016 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.165557 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.165712 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.165830 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.165970 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.166115 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.166251 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.166401 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.166624 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.166716 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.166791 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.166870 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.166987 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.167300 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.167506 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.167623 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.167715 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.167807 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.168024 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.168120 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.168340 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.168456 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.168672 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.168819 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.168985 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.169195 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.169347 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.169505 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.169649 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.169799 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.169977 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.170078 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.170199 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.170287 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.170484 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.170594 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.171126 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.171340 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.171595 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.171758 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.171954 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.172113 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.172271 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.172422 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.172626 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.172773 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.172936 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.173152 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.173319 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.173468 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.173626 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.173722 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.173815 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.173901 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.173991 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.174295 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.174461 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.174619 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.174771 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.174920 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.175039 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.175039 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.175222 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.175316 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.175402 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.175542 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.175655 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.175855 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.175954 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.176166 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.176259 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.176475 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.176574 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.176785 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.176875 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.177094 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.177189 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.177492 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.177678 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.177774 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.177859 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.178028 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.178120 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.178376 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.178472 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.178693 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.178959 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.179148 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.179454 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.179589 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.179804 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.179897 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.180122 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.180214 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.180446 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.180537 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.180768 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.180860 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.181097 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.181286 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.181500 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.181625 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.181721 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.181815 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.182039 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.182140 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.182352 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.182465 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.182678 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.182779 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.182996 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.183088 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.183317 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.183437 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.183794 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.183870 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.183997 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.184088 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.184333 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.184435 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.184648 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.184739 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.184962 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.185052 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.185276 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.185408 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.185610 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.185711 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.185927 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.186018 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.186259 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.186415 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.186696 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.186958 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.187131 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.187280 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.187437 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.187822 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.188043 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.188194 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.188292 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.188378 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.188476 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.188681 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.188783 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.188999 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.189097 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.189320 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.189427 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.189633 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.190426 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.190588 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.190756 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.190893 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.190994 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.191144 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.191284 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.191500 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.191651 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.191799 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.191960 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.192200 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.192347 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.192641 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.192738 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.192975 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.193323 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.193460 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.193650 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.193778 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.193968 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.194109 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.194440 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.194563 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.194776 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.195068 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.195228 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.195423 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.195566 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.195783 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.196069 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.196190 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.196401 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.196640 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.196766 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.197015 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.197151 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.197296 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.197424 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.197804 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.198096 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.198419 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.198711 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.198824 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.199042 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.199179 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.199359 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.199450 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.199704 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.199839 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.200036 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.200154 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.200353 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.200472 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.200691 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.200834 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.201061 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.201172 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.202032 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.202143 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.202246 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.202353 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.202444 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.202539 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.202669 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.202833 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.202986 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.203174 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.203328 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.203532 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.203680 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.203840 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.203996 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.204155 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.204302 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.204450 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.204606 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.204725 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.204860 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.205010 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.205148 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.205311 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.205977 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.206123 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.206216 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.206490 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.206591 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.206778 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.206893 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.207106 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.207269 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.207494 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.207687 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.207882 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.208098 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.208258 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.208391 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.208474 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.208547 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.208719 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.208965 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.209128 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.209289 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.209443 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.209584 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.209740 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.209881 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.210022 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.210165 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.210307 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.210413 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.210528 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.210841 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.210984 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.211172 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.211501 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.211604 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.211838 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.212029 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.212164 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.212372 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.212483 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.212718 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.212825 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.213073 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.213164 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.213425 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.213526 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.213745 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.213880 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.214086 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.214184 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.214417 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.214558 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.214733 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.214829 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.216064 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.216198 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.216302 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.216400 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.216499 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.216596 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.216685 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.216771 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.216865 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.216865 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.217046 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.217936 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.218027 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.218103 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.218103 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.218316 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.218394 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.218476 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.218550 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.218550 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.218697 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.219719 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.219827 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.219916 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.219916 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.220114 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.220229 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.220380 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.220478 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.220478 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.220636 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.220731 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.220952 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.221060 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.221452 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.221905 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.222015 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.222250 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.222475 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.222602 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.222909 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.223017 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.223242 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.223373 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.223629 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.223741 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.224135 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.224247 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.224374 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.224496 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.224718 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.224968 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.225364 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.225525 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.225631 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.226496 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.226610 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.226697 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.226697 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.226863 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.227092 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.227443 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.227789 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.227912 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.228446 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.228446 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.228697 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.228822 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.228945 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.229059 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.229180 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.229332 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.229791 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.229941 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.230065 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.230367 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.230667 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.230860 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.231014 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.231295 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.231428 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.231669 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.231987 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.232120 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.232302 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.232591 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.232849 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.233032 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.233296 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.233572 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.233822 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.234285 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.234568 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.234786 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.234961 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.235127 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.235127 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.235417 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.235417 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.235771 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.235935 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.236101 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.236262 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.236421 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.237103 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.237266 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.237493 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.237775 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.237948 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.238137 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.238484 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.238866 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.238866 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.239179 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.239403 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.239585 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.239853 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.240132 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.240402 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.240703 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.240703 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.241163 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.241327 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.241481 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.241695 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.241889 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.242195 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.242471 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.242789 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.242789 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.242789 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.243368 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.243672 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.243991 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.244287 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.244639 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.244888 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.245150 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.245395 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.245395 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.245860 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.246196 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.246464 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.246712 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.247010 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.247258 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.247543 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.247888 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.248129 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.248390 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.249111 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.249363 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.249616 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.249859 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.250088 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.250337 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.250576 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.250814 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.251096 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.251507 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.251738 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.251738 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.252053 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.252053 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.253065 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.253233 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.253395 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.253562 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.253716 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.253928 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.254089 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.254247 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.254407 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.254587 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.254822 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.254996 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.255157 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.255317 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.255497 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.255669 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.255842 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.255996 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.256148 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.256300 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.256452 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.256610 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.256772 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.256928 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.257079 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.257231 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.257383 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.257542 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.257714 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.257714 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.257714 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.258151 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.258302 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.258453 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.258633 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.259109 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.259278 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.259278 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.259616 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.259783 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.259783 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.260086 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.260238 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.260397 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.260550 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.260715 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.260874 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.260874 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.261182 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.261334 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.261599 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.261839 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.261994 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.262161 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.262161 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.262449 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.262600 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.262761 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.262920 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.262920 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.263207 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.263366 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.263366 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.263769 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.263929 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.264089 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.264252 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.264403 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.264569 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.264721 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.264961 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.265121 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.265274 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.265274 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.265571 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.265571 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.265858 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.265858 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.266164 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.266320 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.266481 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.266653 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.266814 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.266965 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.267124 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.267285 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.267522 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.267709 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.267709 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.268031 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.268233 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.268412 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.268573 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.268573 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.269124 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.269469 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.269469 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.269469 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.269469 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.270134 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.270286 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.270438 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.270599 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.270599 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.270599 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.270599 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.271224 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.271384 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.271594 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.271859 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.271859 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.271859 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.272308 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.272469 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.272636 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.272789 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.272947 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.273118 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.273280 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.273441 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.273602 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.273756 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.273914 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.274065 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.274223 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.274396 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.274556 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.274710 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.274958 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.275207 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.275373 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.275583 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.275583 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.275881 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.276033 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.276185 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.276337 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.276502 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.276662 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.276868 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.277032 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.277223 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.277223 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.277798 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.277965 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.278136 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.278289 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.278602 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.278868 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.279581 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.279690 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.279783 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.279873 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.279960 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.280073 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.280073 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.280250 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.280338 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.280424 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.280424 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.280601 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.280601 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.280784 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.280879 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.280976 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.281063 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.281159 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.281256 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.281344 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.281451 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.281605 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.281605 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.281785 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.281874 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.281874 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.282007 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.282088 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.282088 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.282263 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.282358 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.282358 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.282553 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.282715 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.282715 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.283018 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.283172 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.283338 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.283512 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.283813 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.284005 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.284148 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.284245 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.284333 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.284420 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.284523 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.284620 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.284763 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.284871 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.285084 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.285405 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.285518 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.285724 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.285851 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.286053 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.286235 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.286420 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.286570 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.286715 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.286991 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.287104 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.287420 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.287697 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.287958 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.288165 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.288345 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.288503 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.288695 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.288841 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.289042 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.289363 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.289537 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.289694 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.289848 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.290010 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.290164 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.290315 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.290467 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.290649 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.290809 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.290973 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.291129 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.291282 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.291445 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.291703 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.291876 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.292014 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.292137 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.292408 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.292504 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.292738 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.293078 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.293189 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.293414 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.293516 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.293756 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.293859 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.294093 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.294189 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.294420 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.294603 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.294769 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.295096 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.295198 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.295428 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.295630 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.295792 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.295959 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.296111 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.296431 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.296537 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.296763 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.297028 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.297137 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.297377 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.297472 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.297718 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.297953 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.298048 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.298306 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.298449 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.298669 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.298776 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.298997 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.299798 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.299929 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.300057 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.300263 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.300389 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.300619 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.300739 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.300931 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.301059 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.301254 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.301515 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 16 16:03:10.302036 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.302388 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.302727 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.303045 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.303383 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.303753 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.304087 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.304418 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.304817 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.305264 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.307513 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.307513 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.307513 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.307513 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.307513 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.307513 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.307995 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.307995 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.308480 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.308579 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.308937 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.309260 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.309617 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.309957 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.310281 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.310601 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.310915 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:03:10.311163 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 16 16:03:10.332605 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_db.sqlalchemy.engines [None req-1793b1ce-df29-47e3-aba0-769a552c36e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116084) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 16:03:10.335002 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_db.sqlalchemy.engines [None req-b4161d8f-083f-4fef-9c91-547e2c69940a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116085) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 16:03:10.510517 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.context [None req-b4161d8f-083f-4fef-9c91-547e2c69940a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),153e4b82-24f7-482f-a6a4-3a6422fd3ad2(cell1) {{(pid=116085) load_cells /opt/stack/nova/nova/context.py:464}} Nov 16 16:03:10.515050 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b4161d8f-083f-4fef-9c91-547e2c69940a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:03:10.516687 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b4161d8f-083f-4fef-9c91-547e2c69940a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:03:10.517654 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b4161d8f-083f-4fef-9c91-547e2c69940a None None] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:03:10.519714 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b4161d8f-083f-4fef-9c91-547e2c69940a None None] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:03:10.521653 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.context [None req-1793b1ce-df29-47e3-aba0-769a552c36e7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),153e4b82-24f7-482f-a6a4-3a6422fd3ad2(cell1) {{(pid=116084) load_cells /opt/stack/nova/nova/context.py:464}} Nov 16 16:03:10.526179 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1793b1ce-df29-47e3-aba0-769a552c36e7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:03:10.528170 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1793b1ce-df29-47e3-aba0-769a552c36e7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:03:10.528986 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1793b1ce-df29-47e3-aba0-769a552c36e7 None None] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:03:10.530508 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_db.sqlalchemy.engines [None req-b4161d8f-083f-4fef-9c91-547e2c69940a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116085) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 16:03:10.531008 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1793b1ce-df29-47e3-aba0-769a552c36e7 None None] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:03:10.543896 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_db.sqlalchemy.engines [None req-1793b1ce-df29-47e3-aba0-769a552c36e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116084) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 16:03:10.546005 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_db.sqlalchemy.engines [None req-1793b1ce-df29-47e3-aba0-769a552c36e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116084) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 16:03:10.680406 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_db.sqlalchemy.engines [None req-b4161d8f-083f-4fef-9c91-547e2c69940a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116085) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 16:03:10.701274 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_db.sqlalchemy.engines [None req-b4161d8f-083f-4fef-9c91-547e2c69940a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116085) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 16:03:10.715369 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_db.sqlalchemy.engines [None req-1793b1ce-df29-47e3-aba0-769a552c36e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116084) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 16:03:11.039580 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: WARNING keystonemiddleware.auth_token [None req-b4161d8f-083f-4fef-9c91-547e2c69940a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 16 16:03:11.046192 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: WARNING keystonemiddleware.auth_token [None req-b4161d8f-083f-4fef-9c91-547e2c69940a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 16 16:03:11.055566 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: WARNING keystonemiddleware.auth_token [None req-1793b1ce-df29-47e3-aba0-769a552c36e7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 16 16:03:11.062420 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: WARNING keystonemiddleware.auth_token [None req-1793b1ce-df29-47e3-aba0-769a552c36e7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 16 16:03:11.395441 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: WARNING keystonemiddleware.auth_token [None req-b4161d8f-083f-4fef-9c91-547e2c69940a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 16 16:03:11.400948 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: WARNING keystonemiddleware.auth_token [None req-b4161d8f-083f-4fef-9c91-547e2c69940a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 16 16:03:11.406634 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5582641369c0 pid: 116085 (default app) Nov 16 16:03:11.414086 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: WARNING keystonemiddleware.auth_token [None req-1793b1ce-df29-47e3-aba0-769a552c36e7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 16 16:03:11.419416 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: WARNING keystonemiddleware.auth_token [None req-1793b1ce-df29-47e3-aba0-769a552c36e7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 16 16:03:11.424857 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5582641369c0 pid: 116084 (default app) Nov 16 16:03:46.327856 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-b15751ae-ef2f-4d85-83f1-58494d218fbf tempest-VolumesSnapshotsTestJSON-2106553758 tempest-VolumesSnapshotsTestJSON-2106553758-project] Action: 'create', calling method: .version_select at 0x7f113e37dd30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-788589790"}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:03:48.310172 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-b15751ae-ef2f-4d85-83f1-58494d218fbf tempest-VolumesSnapshotsTestJSON-2106553758 tempest-VolumesSnapshotsTestJSON-2106553758-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.985793 Nov 16 16:03:48.310872 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 1/1] 10.222.0.46 () {60 vars in 1154 bytes} [Tue Nov 16 16:03:45 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 2989 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Nov 16 16:03:48.312551 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6815ffd8-5668-4354-8458-b4c72360cf34 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1064724909", "imageRef": "7c3bd8e0-8d7e-4cf7-90db-742c4f55e405", "flavorRef": "452", "networks": [{"uuid": "d9bdf219-f7fe-484d-8f47-eb89edc86701"}]}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:03:48.323552 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-da0fe142-7a0d-4a67-804e-7dac47f72a00 tempest-VolumesSnapshotsTestJSON-2106553758 tempest-VolumesSnapshotsTestJSON-2106553758-project] Calling method '.version_select at 0x7f113e1cf8b0>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:03:48.425500 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-da0fe142-7a0d-4a67-804e-7dac47f72a00 tempest-VolumesSnapshotsTestJSON-2106553758 tempest-VolumesSnapshotsTestJSON-2106553758-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/172573cc-99c1-4510-b59a-a00999ad09a1" status: 200 len: 344 microversion: 2.1 time: 0.105840 Nov 16 16:03:48.426294 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 2/2] 10.222.0.46 () {58 vars in 1244 bytes} [Tue Nov 16 16:03:48 2021] GET /compute/v2.1/os-volumes/172573cc-99c1-4510-b59a-a00999ad09a1 => generated 344 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:03:48.905738 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.network.neutron [None req-6815ffd8-5668-4354-8458-b4c72360cf34 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] validate_networks() for [('d9bdf219-f7fe-484d-8f47-eb89edc86701', None, None, None, None, None)] {{(pid=116084) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 16:03:49.442535 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-7a02d6cc-2ab2-48b3-9d84-27afb46193d8 tempest-VolumesSnapshotsTestJSON-2106553758 tempest-VolumesSnapshotsTestJSON-2106553758-project] Calling method '.version_select at 0x7f113e1cff70>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:03:49.535330 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-7a02d6cc-2ab2-48b3-9d84-27afb46193d8 tempest-VolumesSnapshotsTestJSON-2106553758 tempest-VolumesSnapshotsTestJSON-2106553758-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/172573cc-99c1-4510-b59a-a00999ad09a1" status: 200 len: 345 microversion: 2.1 time: 0.100627 Nov 16 16:03:49.536283 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 3/3] 10.222.0.46 () {58 vars in 1244 bytes} [Tue Nov 16 16:03:49 2021] GET /compute/v2.1/os-volumes/172573cc-99c1-4510-b59a-a00999ad09a1 => generated 345 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:03:49.559391 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-7277b5df-c445-4895-8123-187c6f999d35 tempest-VolumesSnapshotsTestJSON-2106553758 tempest-VolumesSnapshotsTestJSON-2106553758-project] Action: 'create', calling method: .version_select at 0x7f113e1de280>, body: {"snapshot": {"volume_id": "172573cc-99c1-4510-b59a-a00999ad09a1", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-928267690"}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:03:49.988850 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-7277b5df-c445-4895-8123-187c6f999d35 tempest-VolumesSnapshotsTestJSON-2106553758 tempest-VolumesSnapshotsTestJSON-2106553758-project] 10.222.0.46 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.445173 Nov 16 16:03:49.989434 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 4/4] 10.222.0.46 () {60 vars in 1161 bytes} [Tue Nov 16 16:03:49 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:03:49.999083 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-ed887d64-ed76-4029-8383-c0753a066ab9 tempest-VolumesSnapshotsTestJSON-2106553758 tempest-VolumesSnapshotsTestJSON-2106553758-project] Calling method '.version_select at 0x7f113e1dee50>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:03:50.090726 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-ed887d64-ed76-4029-8383-c0753a066ab9 tempest-VolumesSnapshotsTestJSON-2106553758 tempest-VolumesSnapshotsTestJSON-2106553758-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/a7a6ebaf-6233-4ccd-8e2e-9a326de99d90" status: 200 len: 286 microversion: 2.1 time: 0.095088 Nov 16 16:03:50.091340 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 5/5] 10.222.0.46 () {58 vars in 1250 bytes} [Tue Nov 16 16:03:49 2021] GET /compute/v2.1/os-snapshots/a7a6ebaf-6233-4ccd-8e2e-9a326de99d90 => generated 286 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:03:50.102373 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-590fe4c2-30b9-473f-ad32-03d39e72167f tempest-VolumesSnapshotsTestJSON-2106553758 tempest-VolumesSnapshotsTestJSON-2106553758-project] Calling method '.version_select at 0x7f113e1ded30>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:03:50.161674 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-590fe4c2-30b9-473f-ad32-03d39e72167f tempest-VolumesSnapshotsTestJSON-2106553758 tempest-VolumesSnapshotsTestJSON-2106553758-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.063519 Nov 16 16:03:50.162478 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 6/6] 10.222.0.46 () {58 vars in 1139 bytes} [Tue Nov 16 16:03:50 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:03:50.172683 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-686f3a75-f2e5-47e2-ad93-c2b96a19d13c tempest-VolumesSnapshotsTestJSON-2106553758 tempest-VolumesSnapshotsTestJSON-2106553758-project] Calling method '.version_select at 0x7f113e1cfe50>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:03:50.238627 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-686f3a75-f2e5-47e2-ad93-c2b96a19d13c tempest-VolumesSnapshotsTestJSON-2106553758 tempest-VolumesSnapshotsTestJSON-2106553758-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/a7a6ebaf-6233-4ccd-8e2e-9a326de99d90" status: 200 len: 286 microversion: 2.1 time: 0.069465 Nov 16 16:03:50.239191 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 7/7] 10.222.0.46 () {58 vars in 1250 bytes} [Tue Nov 16 16:03:50 2021] GET /compute/v2.1/os-snapshots/a7a6ebaf-6233-4ccd-8e2e-9a326de99d90 => generated 286 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:03:50.778156 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-6815ffd8-5668-4354-8458-b4c72360cf34 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Flavor limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 16:03:50.778873 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-6815ffd8-5668-4354-8458-b4c72360cf34 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Image limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 16:03:50.779600 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-6815ffd8-5668-4354-8458-b4c72360cf34 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Flavor pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 16:03:50.779950 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-6815ffd8-5668-4354-8458-b4c72360cf34 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Image pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 16:03:50.780374 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-6815ffd8-5668-4354-8458-b4c72360cf34 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 16:03:50.821312 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6815ffd8-5668-4354-8458-b4c72360cf34 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:03:50.821312 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6815ffd8-5668-4354-8458-b4c72360cf34 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:03:50.821312 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6815ffd8-5668-4354-8458-b4c72360cf34 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:03:50.821312 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6815ffd8-5668-4354-8458-b4c72360cf34 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:03:50.925523 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-6815ffd8-5668-4354-8458-b4c72360cf34 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Getting quotas for project 565c2a8ebcd14908b53a63401ebcb81c. Resources: {'instances', 'ram', 'cores'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:03:50.934259 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-6815ffd8-5668-4354-8458-b4c72360cf34 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Getting quotas for user 697a7c6cbf144a6d9d8594b9c8553c8a and project 565c2a8ebcd14908b53a63401ebcb81c. Resources: {'instances', 'ram', 'cores'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:03:50.952612 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-6815ffd8-5668-4354-8458-b4c72360cf34 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Going to run 1 instances... {{(pid=116084) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 16:03:50.958072 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-6815ffd8-5668-4354-8458-b4c72360cf34 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] [instance: d8c53b20-4a71-421c-b123-bd5f6ccc6fe0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c3bd8e0-8d7e-4cf7-90db-742c4f55e405',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116084) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 16:03:51.183486 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-6815ffd8-5668-4354-8458-b4c72360cf34 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.270344 Nov 16 16:03:51.189365 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 1/8] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 16 16:03:46 2021] POST /compute/v2.1/servers => generated 380 bytes in 4278 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 16:03:51.206781 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-72b50941-b675-4e0e-9472-ac37fd8c45a5 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:03:51.207578 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-72b50941-b675-4e0e-9472-ac37fd8c45a5 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] [instance: d8c53b20-4a71-421c-b123-bd5f6ccc6fe0] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:03:51.251956 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-aea81275-c1ea-4e98-8695-60c3ed740cf3 tempest-VolumesSnapshotsTestJSON-2106553758 tempest-VolumesSnapshotsTestJSON-2106553758-project] Calling method '.version_select at 0x7f113e17a670>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:03:51.427356 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-aea81275-c1ea-4e98-8695-60c3ed740cf3 tempest-VolumesSnapshotsTestJSON-2106553758 tempest-VolumesSnapshotsTestJSON-2106553758-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/a7a6ebaf-6233-4ccd-8e2e-9a326de99d90" status: 200 len: 286 microversion: 2.1 time: 0.180863 Nov 16 16:03:51.428052 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 2/9] 10.222.0.46 () {58 vars in 1250 bytes} [Tue Nov 16 16:03:51 2021] GET /compute/v2.1/os-snapshots/a7a6ebaf-6233-4ccd-8e2e-9a326de99d90 => generated 286 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:03:51.496850 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-72b50941-b675-4e0e-9472-ac37fd8c45a5 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697a7c6cbf144a6d9d8594b9c8553c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565c2a8ebcd14908b53a63401ebcb81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:03:51.520783 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-72b50941-b675-4e0e-9472-ac37fd8c45a5 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] 10.222.0.46 "GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0" status: 200 len: 1215 microversion: 2.1 time: 0.324505 Nov 16 16:03:51.521389 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 8/10] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:03:51 2021] GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0 => generated 1215 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:03:52.440728 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b0320162-c949-4cb5-95ec-03329565faa7 tempest-VolumesSnapshotsTestJSON-2106553758 tempest-VolumesSnapshotsTestJSON-2106553758-project] Calling method '.version_select at 0x7f113e17aee0>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:03:52.506025 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b0320162-c949-4cb5-95ec-03329565faa7 tempest-VolumesSnapshotsTestJSON-2106553758 tempest-VolumesSnapshotsTestJSON-2106553758-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/a7a6ebaf-6233-4ccd-8e2e-9a326de99d90" status: 200 len: 286 microversion: 2.1 time: 0.070147 Nov 16 16:03:52.506602 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 3/11] 10.222.0.46 () {58 vars in 1250 bytes} [Tue Nov 16 16:03:52 2021] GET /compute/v2.1/os-snapshots/a7a6ebaf-6233-4ccd-8e2e-9a326de99d90 => generated 286 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:03:52.538482 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-40b161e6-5c3f-42f7-9c62-ac655187166a tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:03:52.539091 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-40b161e6-5c3f-42f7-9c62-ac655187166a tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] [instance: d8c53b20-4a71-421c-b123-bd5f6ccc6fe0] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:03:53.209026 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-40b161e6-5c3f-42f7-9c62-ac655187166a tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697a7c6cbf144a6d9d8594b9c8553c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565c2a8ebcd14908b53a63401ebcb81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:03:53.216780 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-40b161e6-5c3f-42f7-9c62-ac655187166a tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] 10.222.0.46 "GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0" status: 200 len: 1215 microversion: 2.1 time: 0.681717 Nov 16 16:03:53.222729 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 9/12] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:03:52 2021] GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0 => generated 1215 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:03:53.517910 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6998fc13-555d-4b1e-b191-818095828140 tempest-VolumesSnapshotsTestJSON-2106553758 tempest-VolumesSnapshotsTestJSON-2106553758-project] Calling method '.version_select at 0x7f113d0ed9d0>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:03:53.572657 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-6998fc13-555d-4b1e-b191-818095828140 tempest-VolumesSnapshotsTestJSON-2106553758 tempest-VolumesSnapshotsTestJSON-2106553758-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/a7a6ebaf-6233-4ccd-8e2e-9a326de99d90" status: 200 len: 287 microversion: 2.1 time: 0.058961 Nov 16 16:03:53.573220 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 4/13] 10.222.0.46 () {58 vars in 1250 bytes} [Tue Nov 16 16:03:53 2021] GET /compute/v2.1/os-snapshots/a7a6ebaf-6233-4ccd-8e2e-9a326de99d90 => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:03:53.583220 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-1843eb85-04e2-446a-9827-815ad7143c9b tempest-VolumesSnapshotsTestJSON-2106553758 tempest-VolumesSnapshotsTestJSON-2106553758-project] Calling method '.version_select at 0x7f113e1a7a60>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:03:53.714760 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-1843eb85-04e2-446a-9827-815ad7143c9b tempest-VolumesSnapshotsTestJSON-2106553758 tempest-VolumesSnapshotsTestJSON-2106553758-project] 10.222.0.46 "DELETE /compute/v2.1/os-snapshots/a7a6ebaf-6233-4ccd-8e2e-9a326de99d90" status: 202 len: 0 microversion: 2.1 time: 0.135028 Nov 16 16:03:53.715483 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 10/14] 10.222.0.46 () {58 vars in 1253 bytes} [Tue Nov 16 16:03:53 2021] DELETE /compute/v2.1/os-snapshots/a7a6ebaf-6233-4ccd-8e2e-9a326de99d90 => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:03:53.738346 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-52cb96e8-d5fa-4e87-8206-90366dc2cac8 tempest-VolumesSnapshotsTestJSON-2106553758 tempest-VolumesSnapshotsTestJSON-2106553758-project] Calling method '.version_select at 0x7f113d0f4310>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:03:53.799197 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-52cb96e8-d5fa-4e87-8206-90366dc2cac8 tempest-VolumesSnapshotsTestJSON-2106553758 tempest-VolumesSnapshotsTestJSON-2106553758-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/a7a6ebaf-6233-4ccd-8e2e-9a326de99d90" status: 200 len: 286 microversion: 2.1 time: 0.079315 Nov 16 16:03:53.800259 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 5/15] 10.222.0.46 () {58 vars in 1250 bytes} [Tue Nov 16 16:03:53 2021] GET /compute/v2.1/os-snapshots/a7a6ebaf-6233-4ccd-8e2e-9a326de99d90 => generated 286 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:03:54.235498 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-6dd9f1a0-c51c-4c7d-996c-6d46a48fbb33 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:03:54.236343 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-6dd9f1a0-c51c-4c7d-996c-6d46a48fbb33 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] [instance: d8c53b20-4a71-421c-b123-bd5f6ccc6fe0] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:03:54.246070 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6dd9f1a0-c51c-4c7d-996c-6d46a48fbb33 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:03:54.255602 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6dd9f1a0-c51c-4c7d-996c-6d46a48fbb33 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:03:54.257014 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6dd9f1a0-c51c-4c7d-996c-6d46a48fbb33 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:03:54.257653 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6dd9f1a0-c51c-4c7d-996c-6d46a48fbb33 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:03:54.497516 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-6dd9f1a0-c51c-4c7d-996c-6d46a48fbb33 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697a7c6cbf144a6d9d8594b9c8553c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565c2a8ebcd14908b53a63401ebcb81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:03:54.513294 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-6dd9f1a0-c51c-4c7d-996c-6d46a48fbb33 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] 10.222.0.46 "GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0" status: 200 len: 1211 microversion: 2.1 time: 0.281352 Nov 16 16:03:54.517736 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 11/16] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:03:54 2021] GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0 => generated 1211 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:03:54.812548 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-aaca504d-495e-4fef-bdcf-5bf27451463b tempest-VolumesSnapshotsTestJSON-2106553758 tempest-VolumesSnapshotsTestJSON-2106553758-project] Calling method '.version_select at 0x7f113d0eddc0>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:03:54.913842 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-aaca504d-495e-4fef-bdcf-5bf27451463b tempest-VolumesSnapshotsTestJSON-2106553758 tempest-VolumesSnapshotsTestJSON-2106553758-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/a7a6ebaf-6233-4ccd-8e2e-9a326de99d90" status: 200 len: 286 microversion: 2.1 time: 0.105347 Nov 16 16:03:54.914947 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 6/17] 10.222.0.46 () {58 vars in 1250 bytes} [Tue Nov 16 16:03:54 2021] GET /compute/v2.1/os-snapshots/a7a6ebaf-6233-4ccd-8e2e-9a326de99d90 => generated 286 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:03:55.532053 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-332f7682-cab2-48a3-a3e1-adfe0cd69ef2 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:03:55.532658 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-332f7682-cab2-48a3-a3e1-adfe0cd69ef2 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] [instance: d8c53b20-4a71-421c-b123-bd5f6ccc6fe0] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:03:55.542487 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-332f7682-cab2-48a3-a3e1-adfe0cd69ef2 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:03:55.542838 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-332f7682-cab2-48a3-a3e1-adfe0cd69ef2 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:03:55.551557 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-332f7682-cab2-48a3-a3e1-adfe0cd69ef2 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:03:55.552268 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-332f7682-cab2-48a3-a3e1-adfe0cd69ef2 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:03:55.781757 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-332f7682-cab2-48a3-a3e1-adfe0cd69ef2 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697a7c6cbf144a6d9d8594b9c8553c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565c2a8ebcd14908b53a63401ebcb81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:03:55.795115 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-332f7682-cab2-48a3-a3e1-adfe0cd69ef2 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] 10.222.0.46 "GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0" status: 200 len: 1211 microversion: 2.1 time: 0.262294 Nov 16 16:03:55.795967 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 12/18] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:03:55 2021] GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0 => generated 1211 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:03:55.925610 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-2e1735c8-ca68-4dcc-bd5f-e9ee7c9e3f6b tempest-VolumesSnapshotsTestJSON-2106553758 tempest-VolumesSnapshotsTestJSON-2106553758-project] Calling method '.version_select at 0x7f113d0ed550>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:03:55.990548 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-2e1735c8-ca68-4dcc-bd5f-e9ee7c9e3f6b tempest-VolumesSnapshotsTestJSON-2106553758 tempest-VolumesSnapshotsTestJSON-2106553758-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/a7a6ebaf-6233-4ccd-8e2e-9a326de99d90" status: 200 len: 286 microversion: 2.1 time: 0.068731 Nov 16 16:03:55.991522 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 7/19] 10.222.0.46 () {58 vars in 1250 bytes} [Tue Nov 16 16:03:55 2021] GET /compute/v2.1/os-snapshots/a7a6ebaf-6233-4ccd-8e2e-9a326de99d90 => generated 286 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:03:56.828018 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-e90fda88-84af-47f4-bb45-28ff0b4df93f tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:03:56.831015 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-e90fda88-84af-47f4-bb45-28ff0b4df93f tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] [instance: d8c53b20-4a71-421c-b123-bd5f6ccc6fe0] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:03:56.844433 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e90fda88-84af-47f4-bb45-28ff0b4df93f tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:03:56.848397 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e90fda88-84af-47f4-bb45-28ff0b4df93f tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:03:56.852831 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e90fda88-84af-47f4-bb45-28ff0b4df93f tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:03:56.853628 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e90fda88-84af-47f4-bb45-28ff0b4df93f tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:03:57.003229 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-9434fc0c-f41d-4077-8013-34f348cb300c tempest-VolumesSnapshotsTestJSON-2106553758 tempest-VolumesSnapshotsTestJSON-2106553758-project] Calling method '.version_select at 0x7f113d0f4a60>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:03:57.155377 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-e90fda88-84af-47f4-bb45-28ff0b4df93f tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697a7c6cbf144a6d9d8594b9c8553c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565c2a8ebcd14908b53a63401ebcb81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:03:57.165473 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-e90fda88-84af-47f4-bb45-28ff0b4df93f tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] 10.222.0.46 "GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0" status: 200 len: 1211 microversion: 2.1 time: 0.356159 Nov 16 16:03:57.171956 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 13/20] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:03:56 2021] GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0 => generated 1211 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:03:57.188345 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-9434fc0c-f41d-4077-8013-34f348cb300c tempest-VolumesSnapshotsTestJSON-2106553758 tempest-VolumesSnapshotsTestJSON-2106553758-project] HTTP exception thrown: Snapshot a7a6ebaf-6233-4ccd-8e2e-9a326de99d90 could not be found. Nov 16 16:03:57.189154 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-9434fc0c-f41d-4077-8013-34f348cb300c tempest-VolumesSnapshotsTestJSON-2106553758 tempest-VolumesSnapshotsTestJSON-2106553758-project] Returning 404 to user: Snapshot a7a6ebaf-6233-4ccd-8e2e-9a326de99d90 could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:03:57.190097 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-9434fc0c-f41d-4077-8013-34f348cb300c tempest-VolumesSnapshotsTestJSON-2106553758 tempest-VolumesSnapshotsTestJSON-2106553758-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/a7a6ebaf-6233-4ccd-8e2e-9a326de99d90" status: 404 len: 111 microversion: 2.1 time: 0.191629 Nov 16 16:03:57.191880 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 8/21] 10.222.0.46 () {58 vars in 1250 bytes} [Tue Nov 16 16:03:56 2021] GET /compute/v2.1/os-snapshots/a7a6ebaf-6233-4ccd-8e2e-9a326de99d90 => generated 111 bytes in 194 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:03:57.199681 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-e1dc5eb5-0672-404f-9822-ccd3ad955ec6 tempest-VolumesSnapshotsTestJSON-2106553758 tempest-VolumesSnapshotsTestJSON-2106553758-project] Calling method '.version_select at 0x7f113e13c820>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:03:57.497136 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-e1dc5eb5-0672-404f-9822-ccd3ad955ec6 tempest-VolumesSnapshotsTestJSON-2106553758 tempest-VolumesSnapshotsTestJSON-2106553758-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/172573cc-99c1-4510-b59a-a00999ad09a1" status: 202 len: 0 microversion: 2.1 time: 0.302043 Nov 16 16:03:57.498149 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 14/22] 10.222.0.46 () {58 vars in 1247 bytes} [Tue Nov 16 16:03:57 2021] DELETE /compute/v2.1/os-volumes/172573cc-99c1-4510-b59a-a00999ad09a1 => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:03:57.507503 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-65118944-692a-4d34-a4e9-ed8ffea805d4 tempest-VolumesSnapshotsTestJSON-2106553758 tempest-VolumesSnapshotsTestJSON-2106553758-project] Calling method '.version_select at 0x7f113d0ed670>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:03:57.668974 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-65118944-692a-4d34-a4e9-ed8ffea805d4 tempest-VolumesSnapshotsTestJSON-2106553758 tempest-VolumesSnapshotsTestJSON-2106553758-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/172573cc-99c1-4510-b59a-a00999ad09a1" status: 200 len: 344 microversion: 2.1 time: 0.165053 Nov 16 16:03:57.669983 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 9/23] 10.222.0.46 () {58 vars in 1244 bytes} [Tue Nov 16 16:03:57 2021] GET /compute/v2.1/os-volumes/172573cc-99c1-4510-b59a-a00999ad09a1 => generated 344 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:03:58.189768 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-9e9773f7-73e9-424f-ab53-4961c0e746db tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:03:58.190566 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-9e9773f7-73e9-424f-ab53-4961c0e746db tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] [instance: d8c53b20-4a71-421c-b123-bd5f6ccc6fe0] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:03:58.222944 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9e9773f7-73e9-424f-ab53-4961c0e746db tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:03:58.223404 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9e9773f7-73e9-424f-ab53-4961c0e746db tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:03:58.236984 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9e9773f7-73e9-424f-ab53-4961c0e746db tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:03:58.237979 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9e9773f7-73e9-424f-ab53-4961c0e746db tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:03:58.514194 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-f2ad6efe-6759-4986-a4d6-f4fee2e4a3d0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1274534170", "imageRef": "7c3bd8e0-8d7e-4cf7-90db-742c4f55e405", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6e4245df-e56c-4bd9-b7b9-d1dfabd0aad4"}]}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:03:58.667726 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.network.neutron [None req-f2ad6efe-6759-4986-a4d6-f4fee2e4a3d0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] validate_networks() for [('6e4245df-e56c-4bd9-b7b9-d1dfabd0aad4', None, None, None, None, None)] {{(pid=116085) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 16:03:59.065543 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-9e9773f7-73e9-424f-ab53-4961c0e746db tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697a7c6cbf144a6d9d8594b9c8553c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565c2a8ebcd14908b53a63401ebcb81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:03:59.094934 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-9e9773f7-73e9-424f-ab53-4961c0e746db tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] 10.222.0.46 "GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0" status: 200 len: 1273 microversion: 2.1 time: 0.910791 Nov 16 16:03:59.095595 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 10/24] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:03:58 2021] GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0 => generated 1273 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:03:59.116247 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0688e21a-80f9-4890-bc65-1e65d8f0ebd2 tempest-VolumesSnapshotsTestJSON-2106553758 tempest-VolumesSnapshotsTestJSON-2106553758-project] Calling method '.version_select at 0x7f113d021790>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:03:59.179713 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-0688e21a-80f9-4890-bc65-1e65d8f0ebd2 tempest-VolumesSnapshotsTestJSON-2106553758 tempest-VolumesSnapshotsTestJSON-2106553758-project] HTTP exception thrown: Volume 172573cc-99c1-4510-b59a-a00999ad09a1 could not be found. Nov 16 16:03:59.180407 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0688e21a-80f9-4890-bc65-1e65d8f0ebd2 tempest-VolumesSnapshotsTestJSON-2106553758 tempest-VolumesSnapshotsTestJSON-2106553758-project] Returning 404 to user: Volume 172573cc-99c1-4510-b59a-a00999ad09a1 could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:03:59.181252 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0688e21a-80f9-4890-bc65-1e65d8f0ebd2 tempest-VolumesSnapshotsTestJSON-2106553758 tempest-VolumesSnapshotsTestJSON-2106553758-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/172573cc-99c1-4510-b59a-a00999ad09a1" status: 404 len: 109 microversion: 2.1 time: 0.068718 Nov 16 16:03:59.182137 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 11/25] 10.222.0.46 () {58 vars in 1244 bytes} [Tue Nov 16 16:03:59 2021] GET /compute/v2.1/os-volumes/172573cc-99c1-4510-b59a-a00999ad09a1 => generated 109 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:03:59.192684 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d3f5be50-ad9d-44fb-b6b8-f91f67f35aae tempest-VolumesSnapshotsTestJSON-2106553758 tempest-VolumesSnapshotsTestJSON-2106553758-project] Calling method '.version_select at 0x7f113d03ea60>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:03:59.284689 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-d3f5be50-ad9d-44fb-b6b8-f91f67f35aae tempest-VolumesSnapshotsTestJSON-2106553758 tempest-VolumesSnapshotsTestJSON-2106553758-project] HTTP exception thrown: Volume 172573cc-99c1-4510-b59a-a00999ad09a1 could not be found. Nov 16 16:03:59.285586 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d3f5be50-ad9d-44fb-b6b8-f91f67f35aae tempest-VolumesSnapshotsTestJSON-2106553758 tempest-VolumesSnapshotsTestJSON-2106553758-project] Returning 404 to user: Volume 172573cc-99c1-4510-b59a-a00999ad09a1 could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:03:59.286145 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d3f5be50-ad9d-44fb-b6b8-f91f67f35aae tempest-VolumesSnapshotsTestJSON-2106553758 tempest-VolumesSnapshotsTestJSON-2106553758-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/172573cc-99c1-4510-b59a-a00999ad09a1" status: 404 len: 109 microversion: 2.1 time: 0.099092 Nov 16 16:03:59.286697 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 12/26] 10.222.0.46 () {58 vars in 1247 bytes} [Tue Nov 16 16:03:59 2021] DELETE /compute/v2.1/os-volumes/172573cc-99c1-4510-b59a-a00999ad09a1 => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 16 16:03:59.302609 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-9031c4a6-4e12-423f-a031-848dce9a02ca tempest-VolumesSnapshotsTestJSON-2106553758 tempest-VolumesSnapshotsTestJSON-2106553758-project] Calling method '.version_select at 0x7f113d00af70>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:03:59.667401 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-9031c4a6-4e12-423f-a031-848dce9a02ca tempest-VolumesSnapshotsTestJSON-2106553758 tempest-VolumesSnapshotsTestJSON-2106553758-project] HTTP exception thrown: Volume 172573cc-99c1-4510-b59a-a00999ad09a1 could not be found. Nov 16 16:03:59.668239 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-9031c4a6-4e12-423f-a031-848dce9a02ca tempest-VolumesSnapshotsTestJSON-2106553758 tempest-VolumesSnapshotsTestJSON-2106553758-project] Returning 404 to user: Volume 172573cc-99c1-4510-b59a-a00999ad09a1 could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:03:59.669240 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-9031c4a6-4e12-423f-a031-848dce9a02ca tempest-VolumesSnapshotsTestJSON-2106553758 tempest-VolumesSnapshotsTestJSON-2106553758-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/172573cc-99c1-4510-b59a-a00999ad09a1" status: 404 len: 109 microversion: 2.1 time: 0.376921 Nov 16 16:03:59.670312 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 13/27] 10.222.0.46 () {58 vars in 1244 bytes} [Tue Nov 16 16:03:59 2021] GET /compute/v2.1/os-volumes/172573cc-99c1-4510-b59a-a00999ad09a1 => generated 109 bytes in 378 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:04:00.113563 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-fc920341-e1e5-4c0b-9b00-2bd012f5e521 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:00.114543 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-fc920341-e1e5-4c0b-9b00-2bd012f5e521 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] [instance: d8c53b20-4a71-421c-b123-bd5f6ccc6fe0] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:00.134132 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fc920341-e1e5-4c0b-9b00-2bd012f5e521 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:00.135545 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fc920341-e1e5-4c0b-9b00-2bd012f5e521 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:00.138036 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fc920341-e1e5-4c0b-9b00-2bd012f5e521 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:00.149309 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fc920341-e1e5-4c0b-9b00-2bd012f5e521 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:00.602604 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-fc920341-e1e5-4c0b-9b00-2bd012f5e521 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697a7c6cbf144a6d9d8594b9c8553c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565c2a8ebcd14908b53a63401ebcb81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:00.610504 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-fc920341-e1e5-4c0b-9b00-2bd012f5e521 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] 10.222.0.46 "GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0" status: 200 len: 1273 microversion: 2.1 time: 0.500717 Nov 16 16:04:00.611455 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 14/28] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:00 2021] GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0 => generated 1273 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:01.630377 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-98aecc5d-4205-4a67-a7ef-11ec8f61210c tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:01.637451 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-98aecc5d-4205-4a67-a7ef-11ec8f61210c tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] [instance: d8c53b20-4a71-421c-b123-bd5f6ccc6fe0] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:01.655177 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-98aecc5d-4205-4a67-a7ef-11ec8f61210c tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:01.659523 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-98aecc5d-4205-4a67-a7ef-11ec8f61210c tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:01.661195 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-98aecc5d-4205-4a67-a7ef-11ec8f61210c tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:01.665016 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-98aecc5d-4205-4a67-a7ef-11ec8f61210c tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:01.707054 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-f2ad6efe-6759-4986-a4d6-f4fee2e4a3d0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Flavor limits 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 16:04:01.708234 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-f2ad6efe-6759-4986-a4d6-f4fee2e4a3d0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Image limits 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 16:04:01.708960 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-f2ad6efe-6759-4986-a4d6-f4fee2e4a3d0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Flavor pref 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 16:04:01.709564 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-f2ad6efe-6759-4986-a4d6-f4fee2e4a3d0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Image pref 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 16:04:01.710161 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-f2ad6efe-6759-4986-a4d6-f4fee2e4a3d0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 16:04:01.762058 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f2ad6efe-6759-4986-a4d6-f4fee2e4a3d0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:01.766630 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f2ad6efe-6759-4986-a4d6-f4fee2e4a3d0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:01.778303 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f2ad6efe-6759-4986-a4d6-f4fee2e4a3d0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:01.779861 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f2ad6efe-6759-4986-a4d6-f4fee2e4a3d0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:01.866178 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-f2ad6efe-6759-4986-a4d6-f4fee2e4a3d0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Getting quotas for project 29515163ad924903a1d1f653c9f77ee0. Resources: {'instances', 'ram', 'cores'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:04:01.880992 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-f2ad6efe-6759-4986-a4d6-f4fee2e4a3d0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Getting quotas for user ec73bbd7f56e4c1887672a6f1e213377 and project 29515163ad924903a1d1f653c9f77ee0. Resources: {'instances', 'ram', 'cores'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:04:01.905391 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-f2ad6efe-6759-4986-a4d6-f4fee2e4a3d0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Going to run 1 instances... {{(pid=116085) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 16:04:01.923914 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-f2ad6efe-6759-4986-a4d6-f4fee2e4a3d0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c3bd8e0-8d7e-4cf7-90db-742c4f55e405',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116085) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 16:04:01.957063 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-98aecc5d-4205-4a67-a7ef-11ec8f61210c tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697a7c6cbf144a6d9d8594b9c8553c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565c2a8ebcd14908b53a63401ebcb81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:01.967996 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-98aecc5d-4205-4a67-a7ef-11ec8f61210c tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] 10.222.0.46 "GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0" status: 200 len: 1273 microversion: 2.1 time: 0.341336 Nov 16 16:04:01.972994 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 15/29] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:01 2021] GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0 => generated 1273 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:02.137420 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-f2ad6efe-6759-4986-a4d6-f4fee2e4a3d0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.207756 Nov 16 16:04:02.139415 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 15/30] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 16 16:03:57 2021] POST /compute/v2.1/servers => generated 383 bytes in 4211 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 16:04:02.150326 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e7b35811-ea5d-4aa0-99cd-7ca3f5d7a6f1 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:02.151087 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e7b35811-ea5d-4aa0-99cd-7ca3f5d7a6f1 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:02.376743 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e7b35811-ea5d-4aa0-99cd-7ca3f5d7a6f1 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:02.394717 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e7b35811-ea5d-4aa0-99cd-7ca3f5d7a6f1 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1222 microversion: 2.1 time: 0.247997 Nov 16 16:04:02.395158 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 16/31] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:02 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1222 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:02.785059 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-911839be-3411-4af9-b797-17d6b4622863 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1292957857", "imageRef": "7c3bd8e0-8d7e-4cf7-90db-742c4f55e405", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6e4245df-e56c-4bd9-b7b9-d1dfabd0aad4"}]}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:04:02.925229 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.network.neutron [None req-911839be-3411-4af9-b797-17d6b4622863 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] validate_networks() for [('6e4245df-e56c-4bd9-b7b9-d1dfabd0aad4', None, None, None, None, None)] {{(pid=116085) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 16:04:02.989937 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-8b74aced-a363-4f07-8b88-51a702094aab tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:02.990641 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-8b74aced-a363-4f07-8b88-51a702094aab tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] [instance: d8c53b20-4a71-421c-b123-bd5f6ccc6fe0] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:03.003251 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8b74aced-a363-4f07-8b88-51a702094aab tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:03.010743 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8b74aced-a363-4f07-8b88-51a702094aab tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:03.013736 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8b74aced-a363-4f07-8b88-51a702094aab tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:03.014624 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8b74aced-a363-4f07-8b88-51a702094aab tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:03.774518 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-8b74aced-a363-4f07-8b88-51a702094aab tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697a7c6cbf144a6d9d8594b9c8553c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565c2a8ebcd14908b53a63401ebcb81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:03.790465 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-8b74aced-a363-4f07-8b88-51a702094aab tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] 10.222.0.46 "GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0" status: 200 len: 1315 microversion: 2.1 time: 0.801204 Nov 16 16:04:03.795109 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 17/32] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:02 2021] GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0 => generated 1315 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:04:04.738838 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e532fb9c-0878-4bde-8174-c238743adc4d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'create', calling method: .version_select at 0x7f113cfd6b80>, body: {"keypair": {"name": "tempest-keypair-375028814"}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:04:04.801960 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-e532fb9c-0878-4bde-8174-c238743adc4d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Getting quotas for project b827321a45f5478a8bd7953ed7be64b6. Resources: {'key_pairs'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:04:04.814975 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-e532fb9c-0878-4bde-8174-c238743adc4d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Getting quotas for user d2b32db732d2490986e5b70a861de30c and project b827321a45f5478a8bd7953ed7be64b6. Resources: {'key_pairs'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:04:05.106718 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-911839be-3411-4af9-b797-17d6b4622863 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Flavor limits 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 16:04:05.107913 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-911839be-3411-4af9-b797-17d6b4622863 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Image limits 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 16:04:05.112285 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-911839be-3411-4af9-b797-17d6b4622863 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Flavor pref 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 16:04:05.112955 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-911839be-3411-4af9-b797-17d6b4622863 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Image pref 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 16:04:05.113518 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-911839be-3411-4af9-b797-17d6b4622863 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 16:04:05.134893 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-911839be-3411-4af9-b797-17d6b4622863 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:05.135687 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-911839be-3411-4af9-b797-17d6b4622863 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:05.138615 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-911839be-3411-4af9-b797-17d6b4622863 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:05.141080 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-911839be-3411-4af9-b797-17d6b4622863 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:05.218350 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-911839be-3411-4af9-b797-17d6b4622863 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Getting quotas for project 29515163ad924903a1d1f653c9f77ee0. Resources: {'instances', 'ram', 'cores'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:04:05.239330 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-911839be-3411-4af9-b797-17d6b4622863 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Getting quotas for user ec73bbd7f56e4c1887672a6f1e213377 and project 29515163ad924903a1d1f653c9f77ee0. Resources: {'instances', 'ram', 'cores'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:04:05.313620 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-911839be-3411-4af9-b797-17d6b4622863 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Going to run 1 instances... {{(pid=116085) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 16:04:05.316414 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-911839be-3411-4af9-b797-17d6b4622863 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c3bd8e0-8d7e-4cf7-90db-742c4f55e405',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116085) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 16:04:05.533520 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-911839be-3411-4af9-b797-17d6b4622863 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.753647 Nov 16 16:04:05.543843 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 16/33] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 16 16:04:02 2021] POST /compute/v2.1/servers => generated 383 bytes in 2765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 16:04:05.618991 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-e532fb9c-0878-4bde-8174-c238743adc4d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Getting quotas for project b827321a45f5478a8bd7953ed7be64b6. Resources: {'key_pairs'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:04:05.629721 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-e532fb9c-0878-4bde-8174-c238743adc4d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Getting quotas for user d2b32db732d2490986e5b70a861de30c and project b827321a45f5478a8bd7953ed7be64b6. Resources: {'key_pairs'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:04:05.665394 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e532fb9c-0878-4bde-8174-c238743adc4d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 1.868330 Nov 16 16:04:05.667220 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 18/34] 10.222.0.46 () {60 vars in 1157 bytes} [Tue Nov 16 16:04:03 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 1871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:05.703009 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-08d3bea2-fb96-48e7-8d3a-b03d70fa386b tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:05.708871 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-08d3bea2-fb96-48e7-8d3a-b03d70fa386b tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] [instance: d8c53b20-4a71-421c-b123-bd5f6ccc6fe0] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:05.723698 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-08d3bea2-fb96-48e7-8d3a-b03d70fa386b tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:05.727276 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-08d3bea2-fb96-48e7-8d3a-b03d70fa386b tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:05.728758 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-08d3bea2-fb96-48e7-8d3a-b03d70fa386b tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:05.729523 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-08d3bea2-fb96-48e7-8d3a-b03d70fa386b tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:06.414514 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-f7d24bdd-eebc-4cac-997a-8ad37ae30f4b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'create', calling method: .version_select at 0x7f113d7c8550>, body: {"keypair": {"name": "tempest-keypair-1032225550"}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:04:06.496678 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-f7d24bdd-eebc-4cac-997a-8ad37ae30f4b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Getting quotas for project ae9bddc9870246e99f813976878279cb. Resources: {'key_pairs'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:04:06.521584 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-f7d24bdd-eebc-4cac-997a-8ad37ae30f4b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Getting quotas for user 00d8e37d934648708238997bded11462 and project ae9bddc9870246e99f813976878279cb. Resources: {'key_pairs'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:04:07.049785 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-08d3bea2-fb96-48e7-8d3a-b03d70fa386b tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697a7c6cbf144a6d9d8594b9c8553c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565c2a8ebcd14908b53a63401ebcb81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:07.062287 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-08d3bea2-fb96-48e7-8d3a-b03d70fa386b tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] 10.222.0.46 "GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0" status: 200 len: 1315 microversion: 2.1 time: 1.393528 Nov 16 16:04:07.063632 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 19/35] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:05 2021] GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0 => generated 1315 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:07.076609 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e3b184b1-acbc-49b0-bf9b-e8365c8a4ccc tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:07.077454 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e3b184b1-acbc-49b0-bf9b-e8365c8a4ccc tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:07.097686 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e3b184b1-acbc-49b0-bf9b-e8365c8a4ccc tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:07.103695 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e3b184b1-acbc-49b0-bf9b-e8365c8a4ccc tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:07.106082 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e3b184b1-acbc-49b0-bf9b-e8365c8a4ccc tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:07.106584 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e3b184b1-acbc-49b0-bf9b-e8365c8a4ccc tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:07.336347 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-f7d24bdd-eebc-4cac-997a-8ad37ae30f4b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Getting quotas for project ae9bddc9870246e99f813976878279cb. Resources: {'key_pairs'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:04:07.348858 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-f7d24bdd-eebc-4cac-997a-8ad37ae30f4b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Getting quotas for user 00d8e37d934648708238997bded11462 and project ae9bddc9870246e99f813976878279cb. Resources: {'key_pairs'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:04:07.388244 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-f7d24bdd-eebc-4cac-997a-8ad37ae30f4b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 1.843202 Nov 16 16:04:07.399407 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 17/36] 10.222.0.46 () {62 vars in 1198 bytes} [Tue Nov 16 16:04:05 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 1855 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 16 16:04:07.607681 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e3b184b1-acbc-49b0-bf9b-e8365c8a4ccc tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:07.620163 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e3b184b1-acbc-49b0-bf9b-e8365c8a4ccc tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248" status: 200 len: 1226 microversion: 2.1 time: 0.555190 Nov 16 16:04:07.622556 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 20/37] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:07 2021] GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248 => generated 1226 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:07.806214 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-ed6c6072-1869-48ef-a50f-feab56a00ebc tempest-VolumesNegativeTest-52531470 tempest-VolumesNegativeTest-52531470-project] Action: 'create', calling method: .version_select at 0x7f113d7dc160>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1333024684", "metadata": {"Type": "work"}}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:04:07.808253 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-ed6c6072-1869-48ef-a50f-feab56a00ebc tempest-VolumesNegativeTest-52531470 tempest-VolumesNegativeTest-52531470-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:04:07.809412 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-ed6c6072-1869-48ef-a50f-feab56a00ebc tempest-VolumesNegativeTest-52531470 tempest-VolumesNegativeTest-52531470-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.408876 Nov 16 16:04:07.810207 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 18/38] 10.222.0.46 () {60 vars in 1155 bytes} [Tue Nov 16 16:04:07 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 410 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 16 16:04:07.822017 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-eb7ff02e-41e9-42be-a830-ddd8e28699d3 tempest-VolumesNegativeTest-52531470 tempest-VolumesNegativeTest-52531470-project] Action: 'create', calling method: .version_select at 0x7f113cfaa9d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-369181264", "metadata": {"Type": "work"}}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:04:07.824545 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-eb7ff02e-41e9-42be-a830-ddd8e28699d3 tempest-VolumesNegativeTest-52531470 tempest-VolumesNegativeTest-52531470-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:04:07.825646 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-eb7ff02e-41e9-42be-a830-ddd8e28699d3 tempest-VolumesNegativeTest-52531470 tempest-VolumesNegativeTest-52531470-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.007963 Nov 16 16:04:07.826414 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 21/39] 10.222.0.46 () {60 vars in 1155 bytes} [Tue Nov 16 16:04:07 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 16 16:04:07.839020 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-61c4fd98-1413-470d-838a-228bdde5f11d tempest-VolumesNegativeTest-52531470 tempest-VolumesNegativeTest-52531470-project] Action: 'create', calling method: .version_select at 0x7f113c787430>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-750728018", "metadata": {"Type": "work"}}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:04:07.840561 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-61c4fd98-1413-470d-838a-228bdde5f11d tempest-VolumesNegativeTest-52531470 tempest-VolumesNegativeTest-52531470-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:04:07.841667 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-61c4fd98-1413-470d-838a-228bdde5f11d tempest-VolumesNegativeTest-52531470 tempest-VolumesNegativeTest-52531470-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007106 Nov 16 16:04:07.853040 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-01c9de76-bb81-4067-914e-e8d4c1a84812 tempest-VolumesNegativeTest-52531470 tempest-VolumesNegativeTest-52531470-project] Calling method '.version_select at 0x7f113cf8d280>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:07.858402 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 19/40] 10.222.0.46 () {60 vars in 1155 bytes} [Tue Nov 16 16:04:07 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 16 16:04:07.902967 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-01c9de76-bb81-4067-914e-e8d4c1a84812 tempest-VolumesNegativeTest-52531470 tempest-VolumesNegativeTest-52531470-project] HTTP exception thrown: Volume tempest-invalid-369553522 could not be found. Nov 16 16:04:07.904400 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-01c9de76-bb81-4067-914e-e8d4c1a84812 tempest-VolumesNegativeTest-52531470 tempest-VolumesNegativeTest-52531470-project] Returning 404 to user: Volume tempest-invalid-369553522 could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:04:07.906110 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-01c9de76-bb81-4067-914e-e8d4c1a84812 tempest-VolumesNegativeTest-52531470 tempest-VolumesNegativeTest-52531470-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/tempest-invalid-369553522" status: 404 len: 98 microversion: 2.1 time: 0.055985 Nov 16 16:04:07.919272 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 22/41] 10.222.0.46 () {58 vars in 1214 bytes} [Tue Nov 16 16:04:07 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-369553522 => generated 98 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 16 16:04:07.920691 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-994c3886-e716-4070-b09f-defd394159b2 tempest-VolumesNegativeTest-52531470 tempest-VolumesNegativeTest-52531470-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006153 Nov 16 16:04:07.927646 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 20/42] 10.222.0.46 () {58 vars in 1139 bytes} [Tue Nov 16 16:04:07 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 16 16:04:07.936374 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0c8de9ae-5e84-4f9e-92e8-700da9f7b311 tempest-VolumesNegativeTest-52531470 tempest-VolumesNegativeTest-52531470-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006256 Nov 16 16:04:07.941635 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 23/43] 10.222.0.46 () {58 vars in 1136 bytes} [Tue Nov 16 16:04:07 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 16 16:04:07.951593 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-0159df6e-5d3e-4326-af43-72b539bcd9e1 tempest-VolumesNegativeTest-52531470 tempest-VolumesNegativeTest-52531470-project] Calling method '.version_select at 0x7f113d7dcee0>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:08.006019 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.wsgi [None req-0159df6e-5d3e-4326-af43-72b539bcd9e1 tempest-VolumesNegativeTest-52531470 tempest-VolumesNegativeTest-52531470-project] HTTP exception thrown: Volume b5f465da-be4f-42a3-939a-ab9616034fbd could not be found. Nov 16 16:04:08.006621 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-0159df6e-5d3e-4326-af43-72b539bcd9e1 tempest-VolumesNegativeTest-52531470 tempest-VolumesNegativeTest-52531470-project] Returning 404 to user: Volume b5f465da-be4f-42a3-939a-ab9616034fbd could not be found. {{(pid=116085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:04:08.007449 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-0159df6e-5d3e-4326-af43-72b539bcd9e1 tempest-VolumesNegativeTest-52531470 tempest-VolumesNegativeTest-52531470-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/b5f465da-be4f-42a3-939a-ab9616034fbd" status: 404 len: 109 microversion: 2.1 time: 0.063202 Nov 16 16:04:08.008624 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 21/44] 10.222.0.46 () {58 vars in 1247 bytes} [Tue Nov 16 16:04:07 2021] DELETE /compute/v2.1/os-volumes/b5f465da-be4f-42a3-939a-ab9616034fbd => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:04:08.018779 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7507564d-0faf-4537-af67-ce5c4b5bfd84 tempest-VolumesNegativeTest-52531470 tempest-VolumesNegativeTest-52531470-project] Calling method '.version_select at 0x7f113d0218b0>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:08.084341 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-78fffda2-2b60-44f6-92e9-81fba1d06503 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:08.084341 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-78fffda2-2b60-44f6-92e9-81fba1d06503 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] [instance: d8c53b20-4a71-421c-b123-bd5f6ccc6fe0] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:08.112197 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-7507564d-0faf-4537-af67-ce5c4b5bfd84 tempest-VolumesNegativeTest-52531470 tempest-VolumesNegativeTest-52531470-project] HTTP exception thrown: Volume e2ced78f-683f-4174-9bbb-bc7b29cfb38b could not be found. Nov 16 16:04:08.113525 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7507564d-0faf-4537-af67-ce5c4b5bfd84 tempest-VolumesNegativeTest-52531470 tempest-VolumesNegativeTest-52531470-project] Returning 404 to user: Volume e2ced78f-683f-4174-9bbb-bc7b29cfb38b could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:04:08.114096 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-7507564d-0faf-4537-af67-ce5c4b5bfd84 tempest-VolumesNegativeTest-52531470 tempest-VolumesNegativeTest-52531470-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/e2ced78f-683f-4174-9bbb-bc7b29cfb38b" status: 404 len: 109 microversion: 2.1 time: 0.099872 Nov 16 16:04:08.116487 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 24/45] 10.222.0.46 () {58 vars in 1244 bytes} [Tue Nov 16 16:04:08 2021] GET /compute/v2.1/os-volumes/e2ced78f-683f-4174-9bbb-bc7b29cfb38b => generated 109 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 16 16:04:08.125424 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-78fffda2-2b60-44f6-92e9-81fba1d06503 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:08.139922 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-78fffda2-2b60-44f6-92e9-81fba1d06503 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:08.151901 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-78fffda2-2b60-44f6-92e9-81fba1d06503 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:08.153305 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-78fffda2-2b60-44f6-92e9-81fba1d06503 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:08.645408 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-91c3e876-d91b-40ca-a109-eb2663870947 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:08.648779 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-91c3e876-d91b-40ca-a109-eb2663870947 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:08.679072 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-91c3e876-d91b-40ca-a109-eb2663870947 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:08.681857 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-91c3e876-d91b-40ca-a109-eb2663870947 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:08.682857 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-91c3e876-d91b-40ca-a109-eb2663870947 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:08.683308 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-91c3e876-d91b-40ca-a109-eb2663870947 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:09.821110 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-91c3e876-d91b-40ca-a109-eb2663870947 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:09.852508 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-91c3e876-d91b-40ca-a109-eb2663870947 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248" status: 200 len: 1280 microversion: 2.1 time: 1.207776 Nov 16 16:04:09.853421 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 25/46] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:08 2021] GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248 => generated 1280 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:10.870584 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-2eacff26-e8f8-49e1-bf12-fb83d26f9fd8 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:10.871427 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-2eacff26-e8f8-49e1-bf12-fb83d26f9fd8 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:10.882189 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2eacff26-e8f8-49e1-bf12-fb83d26f9fd8 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:10.884106 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2eacff26-e8f8-49e1-bf12-fb83d26f9fd8 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:10.885084 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2eacff26-e8f8-49e1-bf12-fb83d26f9fd8 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:10.898451 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2eacff26-e8f8-49e1-bf12-fb83d26f9fd8 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:11.098502 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-78fffda2-2b60-44f6-92e9-81fba1d06503 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697a7c6cbf144a6d9d8594b9c8553c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565c2a8ebcd14908b53a63401ebcb81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:11.114647 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-78fffda2-2b60-44f6-92e9-81fba1d06503 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] 10.222.0.46 "GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0" status: 200 len: 1315 microversion: 2.1 time: 3.038985 Nov 16 16:04:11.122149 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 22/47] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:08 2021] GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0 => generated 1315 bytes in 3047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:11.394721 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-ab4068a7-8bb4-45e9-b615-6c87dce7738f req-0026d03b-a286-4b1d-8fed-0899fbfb7e9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8c53b20-4a71-421c-b123-bd5f6ccc6fe0", "tag": "4ac187bb-10df-4230-9320-5556a334a54d"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:04:11.397244 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:04:11.397244 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Nov 16 16:04:11.434578 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-ab4068a7-8bb4-45e9-b615-6c87dce7738f req-0026d03b-a286-4b1d-8fed-0899fbfb7e9f service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:11.435288 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-ab4068a7-8bb4-45e9-b615-6c87dce7738f req-0026d03b-a286-4b1d-8fed-0899fbfb7e9f service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:11.494379 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-ab4068a7-8bb4-45e9-b615-6c87dce7738f req-0026d03b-a286-4b1d-8fed-0899fbfb7e9f service nova] Creating event network-changed:4ac187bb-10df-4230-9320-5556a334a54d for instance d8c53b20-4a71-421c-b123-bd5f6ccc6fe0 on hv-cinder-81809 Nov 16 16:04:11.499117 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-ab4068a7-8bb4-45e9-b615-6c87dce7738f req-0026d03b-a286-4b1d-8fed-0899fbfb7e9f service nova] Acquired lock "compute-rpcapi-router" {{(pid=116085) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 16 16:04:11.501132 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d969708b-a964-4747-b293-5a3f291febe3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:11.504039 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d969708b-a964-4747-b293-5a3f291febe3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:11.506146 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d969708b-a964-4747-b293-5a3f291febe3 None None] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:11.512017 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d969708b-a964-4747-b293-5a3f291febe3 None None] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:11.545800 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.compute.rpcapi [None req-d969708b-a964-4747-b293-5a3f291febe3 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 16 16:04:11.552372 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d969708b-a964-4747-b293-5a3f291febe3 None None] Releasing lock "compute-rpcapi-router" {{(pid=116085) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 16 16:04:11.557603 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-2eacff26-e8f8-49e1-bf12-fb83d26f9fd8 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:11.570358 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-2eacff26-e8f8-49e1-bf12-fb83d26f9fd8 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248" status: 200 len: 1280 microversion: 2.1 time: 0.702937 Nov 16 16:04:11.601028 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 26/48] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:10 2021] GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248 => generated 1280 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:11.657078 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-d969708b-a964-4747-b293-5a3f291febe3 None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.432424 Nov 16 16:04:11.657710 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 23/49] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:04:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:04:12.143009 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1cd44c4f-dc86-49f4-aadd-453d48ccae35 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:12.143822 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1cd44c4f-dc86-49f4-aadd-453d48ccae35 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] [instance: d8c53b20-4a71-421c-b123-bd5f6ccc6fe0] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:12.158924 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1cd44c4f-dc86-49f4-aadd-453d48ccae35 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:12.159384 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1cd44c4f-dc86-49f4-aadd-453d48ccae35 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:12.160313 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1cd44c4f-dc86-49f4-aadd-453d48ccae35 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:12.160764 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1cd44c4f-dc86-49f4-aadd-453d48ccae35 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:12.615810 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-5cb3f539-2b65-47cc-9082-83474e689949 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:12.616651 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-5cb3f539-2b65-47cc-9082-83474e689949 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:12.632797 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5cb3f539-2b65-47cc-9082-83474e689949 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:12.633255 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5cb3f539-2b65-47cc-9082-83474e689949 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:12.643601 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5cb3f539-2b65-47cc-9082-83474e689949 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:12.644090 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5cb3f539-2b65-47cc-9082-83474e689949 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:13.063705 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-5cb3f539-2b65-47cc-9082-83474e689949 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:13.072164 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-5cb3f539-2b65-47cc-9082-83474e689949 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248" status: 200 len: 1280 microversion: 2.1 time: 0.460428 Nov 16 16:04:13.088678 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 24/50] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:12 2021] GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248 => generated 1280 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:04:13.210662 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1cd44c4f-dc86-49f4-aadd-453d48ccae35 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697a7c6cbf144a6d9d8594b9c8553c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565c2a8ebcd14908b53a63401ebcb81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:13.228906 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1cd44c4f-dc86-49f4-aadd-453d48ccae35 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] 10.222.0.46 "GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0" status: 200 len: 1315 microversion: 2.1 time: 1.090477 Nov 16 16:04:13.229965 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 27/51] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:12 2021] GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0 => generated 1315 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:04:14.106003 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-c4cbf17c-75e3-478f-be6d-ee63a708e760 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:14.107974 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-c4cbf17c-75e3-478f-be6d-ee63a708e760 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:14.128777 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c4cbf17c-75e3-478f-be6d-ee63a708e760 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:14.131091 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c4cbf17c-75e3-478f-be6d-ee63a708e760 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:14.132237 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c4cbf17c-75e3-478f-be6d-ee63a708e760 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:14.135762 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c4cbf17c-75e3-478f-be6d-ee63a708e760 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:14.267584 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-350f76cc-b3fa-474f-8961-a2d1c73d40ba tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:14.269700 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-350f76cc-b3fa-474f-8961-a2d1c73d40ba tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] [instance: d8c53b20-4a71-421c-b123-bd5f6ccc6fe0] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:14.280842 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-350f76cc-b3fa-474f-8961-a2d1c73d40ba tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:14.282019 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-350f76cc-b3fa-474f-8961-a2d1c73d40ba tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:14.282919 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-350f76cc-b3fa-474f-8961-a2d1c73d40ba tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:14.283360 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-350f76cc-b3fa-474f-8961-a2d1c73d40ba tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:15.660927 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-350f76cc-b3fa-474f-8961-a2d1c73d40ba tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697a7c6cbf144a6d9d8594b9c8553c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565c2a8ebcd14908b53a63401ebcb81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:15.675983 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-350f76cc-b3fa-474f-8961-a2d1c73d40ba tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] 10.222.0.46 "GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0" status: 200 len: 1315 microversion: 2.1 time: 1.420961 Nov 16 16:04:15.677501 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 28/52] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:14 2021] GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0 => generated 1315 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:15.696245 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f0e34309-5738-4fb7-b781-a663c95a8a00 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-47747962", "imageRef": "7c3bd8e0-8d7e-4cf7-90db-742c4f55e405", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ac91b040-5fe3-4eda-b0f1-4bb52cb28b8f"}], "security_groups": [{"name": "tempest-securitygroup--1633276454"}], "key_name": "tempest-keypair-375028814", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:04:15.698262 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-c4cbf17c-75e3-478f-be6d-ee63a708e760 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:15.721110 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-c4cbf17c-75e3-478f-be6d-ee63a708e760 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248" status: 200 len: 1322 microversion: 2.1 time: 1.620501 Nov 16 16:04:15.736665 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 25/53] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:14 2021] GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248 => generated 1322 bytes in 1646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:16.311783 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.network.neutron [None req-f0e34309-5738-4fb7-b781-a663c95a8a00 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] validate_networks() for [('ac91b040-5fe3-4eda-b0f1-4bb52cb28b8f', None, None, None, None, None)] {{(pid=116084) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 16:04:16.324536 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-90e87c83-9a83-4f64-981c-e238a1d2f1ca req-63321edd-570a-4764-bc5b-89c1fdbb43b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69df60e2-42c9-4caa-abdc-a7ecb61d8d73", "tag": "8d515f5e-ebe4-404a-a99d-1abd2b9d5bcc"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:04:16.326093 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:04:16.326093 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Nov 16 16:04:16.347727 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-90e87c83-9a83-4f64-981c-e238a1d2f1ca req-63321edd-570a-4764-bc5b-89c1fdbb43b3 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:16.348173 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-90e87c83-9a83-4f64-981c-e238a1d2f1ca req-63321edd-570a-4764-bc5b-89c1fdbb43b3 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:16.371762 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-90e87c83-9a83-4f64-981c-e238a1d2f1ca req-63321edd-570a-4764-bc5b-89c1fdbb43b3 service nova] Creating event network-changed:8d515f5e-ebe4-404a-a99d-1abd2b9d5bcc for instance 69df60e2-42c9-4caa-abdc-a7ecb61d8d73 on hv-cinder-81809 Nov 16 16:04:16.407534 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-90e87c83-9a83-4f64-981c-e238a1d2f1ca req-63321edd-570a-4764-bc5b-89c1fdbb43b3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.207551 Nov 16 16:04:16.414812 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 26/54] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:04:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:04:16.695791 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-593a9db4-c9eb-4e5d-a64b-ec757970ddb9 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:16.696499 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-593a9db4-c9eb-4e5d-a64b-ec757970ddb9 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] [instance: d8c53b20-4a71-421c-b123-bd5f6ccc6fe0] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:16.707674 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-593a9db4-c9eb-4e5d-a64b-ec757970ddb9 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:16.708382 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-593a9db4-c9eb-4e5d-a64b-ec757970ddb9 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:16.708915 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-593a9db4-c9eb-4e5d-a64b-ec757970ddb9 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:16.709400 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-593a9db4-c9eb-4e5d-a64b-ec757970ddb9 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:17.807897 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-593a9db4-c9eb-4e5d-a64b-ec757970ddb9 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697a7c6cbf144a6d9d8594b9c8553c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565c2a8ebcd14908b53a63401ebcb81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:17.828475 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-593a9db4-c9eb-4e5d-a64b-ec757970ddb9 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] 10.222.0.46 "GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0" status: 200 len: 1315 microversion: 2.1 time: 1.124490 Nov 16 16:04:17.838469 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 27/55] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:16 2021] GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0 => generated 1315 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:17.843255 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-9598cfa3-39d3-47ca-96d1-92ec186787b9 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:17.844594 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-9598cfa3-39d3-47ca-96d1-92ec186787b9 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:17.860590 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9598cfa3-39d3-47ca-96d1-92ec186787b9 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:17.863849 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9598cfa3-39d3-47ca-96d1-92ec186787b9 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:17.863849 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9598cfa3-39d3-47ca-96d1-92ec186787b9 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:17.863849 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9598cfa3-39d3-47ca-96d1-92ec186787b9 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:18.483737 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-9598cfa3-39d3-47ca-96d1-92ec186787b9 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:18.495136 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-9598cfa3-39d3-47ca-96d1-92ec186787b9 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248" status: 200 len: 1322 microversion: 2.1 time: 0.664066 Nov 16 16:04:18.496791 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 28/56] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:17 2021] GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248 => generated 1322 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:18.510223 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-f0e34309-5738-4fb7-b781-a663c95a8a00 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Flavor limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 16:04:18.510680 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-f0e34309-5738-4fb7-b781-a663c95a8a00 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Image limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 16:04:18.511113 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-f0e34309-5738-4fb7-b781-a663c95a8a00 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Flavor pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 16:04:18.511569 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-f0e34309-5738-4fb7-b781-a663c95a8a00 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Image pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 16:04:18.511972 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-f0e34309-5738-4fb7-b781-a663c95a8a00 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 16:04:18.525329 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f0e34309-5738-4fb7-b781-a663c95a8a00 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:18.525791 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f0e34309-5738-4fb7-b781-a663c95a8a00 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:18.526600 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f0e34309-5738-4fb7-b781-a663c95a8a00 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:18.528857 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f0e34309-5738-4fb7-b781-a663c95a8a00 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:18.558421 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-f0e34309-5738-4fb7-b781-a663c95a8a00 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Getting quotas for project b827321a45f5478a8bd7953ed7be64b6. Resources: {'instances', 'ram', 'cores'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:04:18.571022 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-f0e34309-5738-4fb7-b781-a663c95a8a00 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Getting quotas for user d2b32db732d2490986e5b70a861de30c and project b827321a45f5478a8bd7953ed7be64b6. Resources: {'instances', 'ram', 'cores'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:04:18.590361 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f0e34309-5738-4fb7-b781-a663c95a8a00 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Going to run 1 instances... {{(pid=116084) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 16:04:18.594705 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f0e34309-5738-4fb7-b781-a663c95a8a00 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c3bd8e0-8d7e-4cf7-90db-742c4f55e405',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116084) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 16:04:18.656795 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f0e34309-5738-4fb7-b781-a663c95a8a00 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.977863 Nov 16 16:04:18.657450 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 29/57] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 16 16:04:15 2021] POST /compute/v2.1/servers => generated 402 bytes in 2979 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 16:04:18.675053 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-e4a9f67b-fb16-494c-a96b-340929201a95 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:18.675689 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-e4a9f67b-fb16-494c-a96b-340929201a95 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:18.847174 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-54728a54-cef8-48cc-97f8-eaef618e53ef tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:18.850724 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-54728a54-cef8-48cc-97f8-eaef618e53ef tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] [instance: d8c53b20-4a71-421c-b123-bd5f6ccc6fe0] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:18.856350 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-54728a54-cef8-48cc-97f8-eaef618e53ef tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:18.859926 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-54728a54-cef8-48cc-97f8-eaef618e53ef tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:18.860922 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-54728a54-cef8-48cc-97f8-eaef618e53ef tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:18.861217 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-54728a54-cef8-48cc-97f8-eaef618e53ef tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:18.870436 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-e4a9f67b-fb16-494c-a96b-340929201a95 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:18.881351 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-e4a9f67b-fb16-494c-a96b-340929201a95 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1235 microversion: 2.1 time: 0.211332 Nov 16 16:04:18.882292 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 29/58] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:18 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1235 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:19.146846 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-a935751f-21c4-48ea-b131-077ed3682535 req-3c3fdfa0-f281-43b2-a733-f278fe0b5d0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78398054-0c37-4dfb-8926-a199cdf30248", "tag": "79ddbfbc-87d6-4cbb-8ab7-1840fe13a61a"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:04:19.150155 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:04:19.150155 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Nov 16 16:04:19.166069 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-a935751f-21c4-48ea-b131-077ed3682535 req-3c3fdfa0-f281-43b2-a733-f278fe0b5d0f service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:19.166590 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-a935751f-21c4-48ea-b131-077ed3682535 req-3c3fdfa0-f281-43b2-a733-f278fe0b5d0f service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:19.199238 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-a935751f-21c4-48ea-b131-077ed3682535 req-3c3fdfa0-f281-43b2-a733-f278fe0b5d0f service nova] Creating event network-changed:79ddbfbc-87d6-4cbb-8ab7-1840fe13a61a for instance 78398054-0c37-4dfb-8926-a199cdf30248 on hv-cinder-81809 Nov 16 16:04:19.208621 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-a935751f-21c4-48ea-b131-077ed3682535 req-3c3fdfa0-f281-43b2-a733-f278fe0b5d0f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064777 Nov 16 16:04:19.210387 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 30/59] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:04:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:04:19.251285 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-03539bca-9553-4451-bae4-783a222c98fd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-987201449", "imageRef": "7c3bd8e0-8d7e-4cf7-90db-742c4f55e405", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "72ea3377-b38c-416b-8581-98962c72f168"}], "security_groups": [{"name": "tempest-securitygroup--2104459427"}], "key_name": "tempest-keypair-1032225550", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:04:19.255926 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-54728a54-cef8-48cc-97f8-eaef618e53ef tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697a7c6cbf144a6d9d8594b9c8553c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565c2a8ebcd14908b53a63401ebcb81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:19.269876 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-54728a54-cef8-48cc-97f8-eaef618e53ef tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] 10.222.0.46 "GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0" status: 200 len: 1315 microversion: 2.1 time: 0.427313 Nov 16 16:04:19.272161 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 30/60] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:18 2021] GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0 => generated 1315 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:04:19.465221 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.network.neutron [None req-03539bca-9553-4451-bae4-783a222c98fd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] validate_networks() for [('72ea3377-b38c-416b-8581-98962c72f168', None, None, None, None, None)] {{(pid=116085) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 16:04:19.513613 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-212f11f2-082d-44d6-a2c3-3afefbf31537 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:19.514745 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-212f11f2-082d-44d6-a2c3-3afefbf31537 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:19.523188 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-212f11f2-082d-44d6-a2c3-3afefbf31537 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:19.523817 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-212f11f2-082d-44d6-a2c3-3afefbf31537 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:19.524534 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-212f11f2-082d-44d6-a2c3-3afefbf31537 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:19.535187 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-212f11f2-082d-44d6-a2c3-3afefbf31537 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:20.013066 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-212f11f2-082d-44d6-a2c3-3afefbf31537 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:20.022933 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-212f11f2-082d-44d6-a2c3-3afefbf31537 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248" status: 200 len: 1322 microversion: 2.1 time: 0.513144 Nov 16 16:04:20.034517 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 31/61] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:19 2021] GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248 => generated 1322 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:20.040629 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7bb5a698-46c5-4555-b595-750cff80c744 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:20.041692 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-7bb5a698-46c5-4555-b595-750cff80c744 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:20.049618 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7bb5a698-46c5-4555-b595-750cff80c744 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:20.050375 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7bb5a698-46c5-4555-b595-750cff80c744 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:20.051400 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7bb5a698-46c5-4555-b595-750cff80c744 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:20.052061 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7bb5a698-46c5-4555-b595-750cff80c744 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:20.137383 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7bb5a698-46c5-4555-b595-750cff80c744 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:20.154084 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-7bb5a698-46c5-4555-b595-750cff80c744 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1287 microversion: 2.1 time: 0.118270 Nov 16 16:04:20.154678 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 32/62] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:20 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1287 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:20.288401 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-076fbc85-0d01-4697-b5c2-c190d1293bd2 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:20.289314 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-076fbc85-0d01-4697-b5c2-c190d1293bd2 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] [instance: d8c53b20-4a71-421c-b123-bd5f6ccc6fe0] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:20.295589 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-076fbc85-0d01-4697-b5c2-c190d1293bd2 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:20.296169 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-076fbc85-0d01-4697-b5c2-c190d1293bd2 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:20.297501 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-076fbc85-0d01-4697-b5c2-c190d1293bd2 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:20.298402 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-076fbc85-0d01-4697-b5c2-c190d1293bd2 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:20.641693 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-03539bca-9553-4451-bae4-783a222c98fd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Flavor limits 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 16:04:20.642510 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-03539bca-9553-4451-bae4-783a222c98fd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Image limits 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 16:04:20.642689 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-03539bca-9553-4451-bae4-783a222c98fd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Flavor pref 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 16:04:20.643501 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-03539bca-9553-4451-bae4-783a222c98fd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Image pref 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 16:04:20.643973 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-03539bca-9553-4451-bae4-783a222c98fd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 16:04:20.654169 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-03539bca-9553-4451-bae4-783a222c98fd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:20.654703 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-03539bca-9553-4451-bae4-783a222c98fd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:20.655653 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-03539bca-9553-4451-bae4-783a222c98fd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:20.656967 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-03539bca-9553-4451-bae4-783a222c98fd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:20.682979 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-03539bca-9553-4451-bae4-783a222c98fd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Getting quotas for project ae9bddc9870246e99f813976878279cb. Resources: {'instances', 'ram', 'cores'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:04:20.698847 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-03539bca-9553-4451-bae4-783a222c98fd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Getting quotas for user 00d8e37d934648708238997bded11462 and project ae9bddc9870246e99f813976878279cb. Resources: {'instances', 'ram', 'cores'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:04:20.726996 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-076fbc85-0d01-4697-b5c2-c190d1293bd2 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697a7c6cbf144a6d9d8594b9c8553c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565c2a8ebcd14908b53a63401ebcb81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:20.739498 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-076fbc85-0d01-4697-b5c2-c190d1293bd2 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] 10.222.0.46 "GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0" status: 200 len: 1315 microversion: 2.1 time: 0.455059 Nov 16 16:04:20.740327 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 33/63] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:20 2021] GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0 => generated 1315 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:04:20.753549 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-03539bca-9553-4451-bae4-783a222c98fd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Going to run 1 instances... {{(pid=116085) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 16:04:20.756889 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-03539bca-9553-4451-bae4-783a222c98fd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c3bd8e0-8d7e-4cf7-90db-742c4f55e405',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116085) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 16:04:20.813623 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-03539bca-9553-4451-bae4-783a222c98fd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.568145 Nov 16 16:04:20.814565 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 31/64] 10.222.0.46 () {62 vars in 1187 bytes} [Tue Nov 16 16:04:19 2021] POST /compute/v2.1/servers => generated 402 bytes in 1570 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 16 16:04:20.824586 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d4e28f76-c18e-416c-9340-27b699689277 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:20.825418 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d4e28f76-c18e-416c-9340-27b699689277 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:20.902259 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d4e28f76-c18e-416c-9340-27b699689277 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:20.911211 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d4e28f76-c18e-416c-9340-27b699689277 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:20.913108 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d4e28f76-c18e-416c-9340-27b699689277 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:20.915433 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d4e28f76-c18e-416c-9340-27b699689277 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1281 microversion: 2.20 time: 0.094524 Nov 16 16:04:20.916272 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 34/65] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:04:20 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1281 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:04:21.042882 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-5082f132-8f87-4be2-a9f9-2b4fac4f11c0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:21.043938 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-5082f132-8f87-4be2-a9f9-2b4fac4f11c0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:21.052787 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5082f132-8f87-4be2-a9f9-2b4fac4f11c0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:21.053252 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5082f132-8f87-4be2-a9f9-2b4fac4f11c0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:21.054052 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5082f132-8f87-4be2-a9f9-2b4fac4f11c0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:21.054491 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5082f132-8f87-4be2-a9f9-2b4fac4f11c0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:21.179427 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-21183c10-ac75-428d-8330-1136d0ae7729 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:21.180081 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-21183c10-ac75-428d-8330-1136d0ae7729 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:21.190333 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-21183c10-ac75-428d-8330-1136d0ae7729 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:21.190793 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-21183c10-ac75-428d-8330-1136d0ae7729 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:21.191627 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-21183c10-ac75-428d-8330-1136d0ae7729 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:21.192076 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-21183c10-ac75-428d-8330-1136d0ae7729 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:21.298123 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-5082f132-8f87-4be2-a9f9-2b4fac4f11c0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:21.309702 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-5082f132-8f87-4be2-a9f9-2b4fac4f11c0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248" status: 200 len: 1322 microversion: 2.1 time: 0.271991 Nov 16 16:04:21.310298 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 32/66] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:21 2021] GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248 => generated 1322 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:21.323302 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-21183c10-ac75-428d-8330-1136d0ae7729 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:21.336943 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-21183c10-ac75-428d-8330-1136d0ae7729 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1287 microversion: 2.1 time: 0.168873 Nov 16 16:04:21.347529 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 35/67] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:21 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1287 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:21.756284 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-bab96f02-9cbb-4f4c-ba35-d72e7b80da6a tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:21.758049 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-bab96f02-9cbb-4f4c-ba35-d72e7b80da6a tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] [instance: d8c53b20-4a71-421c-b123-bd5f6ccc6fe0] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:21.765712 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bab96f02-9cbb-4f4c-ba35-d72e7b80da6a tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:21.766263 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bab96f02-9cbb-4f4c-ba35-d72e7b80da6a tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:21.767131 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bab96f02-9cbb-4f4c-ba35-d72e7b80da6a tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:21.767604 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bab96f02-9cbb-4f4c-ba35-d72e7b80da6a tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:21.918207 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-bab96f02-9cbb-4f4c-ba35-d72e7b80da6a tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697a7c6cbf144a6d9d8594b9c8553c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565c2a8ebcd14908b53a63401ebcb81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:21.929782 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-bab96f02-9cbb-4f4c-ba35-d72e7b80da6a tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] 10.222.0.46 "GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0" status: 200 len: 1315 microversion: 2.1 time: 0.177207 Nov 16 16:04:21.932107 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 33/68] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:21 2021] GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:21.936427 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7578d8d0-418a-4634-8daf-c53d1f966055 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:21.937863 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-7578d8d0-418a-4634-8daf-c53d1f966055 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:21.944382 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7578d8d0-418a-4634-8daf-c53d1f966055 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:21.944730 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7578d8d0-418a-4634-8daf-c53d1f966055 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:21.945633 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7578d8d0-418a-4634-8daf-c53d1f966055 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:21.946062 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7578d8d0-418a-4634-8daf-c53d1f966055 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:22.014838 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7578d8d0-418a-4634-8daf-c53d1f966055 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:22.024891 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7578d8d0-418a-4634-8daf-c53d1f966055 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:22.026381 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7578d8d0-418a-4634-8daf-c53d1f966055 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:22.027753 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-7578d8d0-418a-4634-8daf-c53d1f966055 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1285 microversion: 2.20 time: 0.094677 Nov 16 16:04:22.028310 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 36/69] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:04:21 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:04:22.326273 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-0967b763-c348-4f50-ad73-19a40e2a9548 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:22.327106 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-0967b763-c348-4f50-ad73-19a40e2a9548 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:22.333782 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0967b763-c348-4f50-ad73-19a40e2a9548 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:22.334225 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0967b763-c348-4f50-ad73-19a40e2a9548 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:22.335188 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0967b763-c348-4f50-ad73-19a40e2a9548 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:22.335650 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0967b763-c348-4f50-ad73-19a40e2a9548 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:22.358516 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0f6f5b7b-9ab8-4ad3-b5da-ff8af4bc0d70 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:22.359866 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0f6f5b7b-9ab8-4ad3-b5da-ff8af4bc0d70 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:22.370201 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0f6f5b7b-9ab8-4ad3-b5da-ff8af4bc0d70 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:22.370789 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0f6f5b7b-9ab8-4ad3-b5da-ff8af4bc0d70 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:22.371621 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0f6f5b7b-9ab8-4ad3-b5da-ff8af4bc0d70 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:22.372524 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0f6f5b7b-9ab8-4ad3-b5da-ff8af4bc0d70 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:22.459245 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0f6f5b7b-9ab8-4ad3-b5da-ff8af4bc0d70 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:22.494467 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0f6f5b7b-9ab8-4ad3-b5da-ff8af4bc0d70 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1287 microversion: 2.1 time: 0.141816 Nov 16 16:04:22.507300 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 37/70] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:22 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1287 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:22.508350 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-0967b763-c348-4f50-ad73-19a40e2a9548 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:22.517286 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-0967b763-c348-4f50-ad73-19a40e2a9548 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248" status: 200 len: 1322 microversion: 2.1 time: 0.194538 Nov 16 16:04:22.518166 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 34/71] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:22 2021] GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248 => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:22.949475 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-28b1a10a-0c8e-4379-a707-d3fe18e0fe36 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:22.950985 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-28b1a10a-0c8e-4379-a707-d3fe18e0fe36 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] [instance: d8c53b20-4a71-421c-b123-bd5f6ccc6fe0] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:22.960235 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-28b1a10a-0c8e-4379-a707-d3fe18e0fe36 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:22.961113 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-28b1a10a-0c8e-4379-a707-d3fe18e0fe36 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:22.961903 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-28b1a10a-0c8e-4379-a707-d3fe18e0fe36 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:22.962543 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-28b1a10a-0c8e-4379-a707-d3fe18e0fe36 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:23.050100 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-8c887ef6-4609-4ddb-ad5f-4a0f6e273a33 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:23.050695 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-8c887ef6-4609-4ddb-ad5f-4a0f6e273a33 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:23.056730 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8c887ef6-4609-4ddb-ad5f-4a0f6e273a33 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:23.057181 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8c887ef6-4609-4ddb-ad5f-4a0f6e273a33 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:23.057967 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8c887ef6-4609-4ddb-ad5f-4a0f6e273a33 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:23.058607 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8c887ef6-4609-4ddb-ad5f-4a0f6e273a33 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:23.156897 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-8c887ef6-4609-4ddb-ad5f-4a0f6e273a33 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:23.167263 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-8c887ef6-4609-4ddb-ad5f-4a0f6e273a33 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:23.171040 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-8c887ef6-4609-4ddb-ad5f-4a0f6e273a33 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:23.173025 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-8c887ef6-4609-4ddb-ad5f-4a0f6e273a33 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1333 microversion: 2.20 time: 0.128417 Nov 16 16:04:23.174337 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 35/72] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:04:23 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1333 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:04:23.191594 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-28b1a10a-0c8e-4379-a707-d3fe18e0fe36 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697a7c6cbf144a6d9d8594b9c8553c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565c2a8ebcd14908b53a63401ebcb81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:23.200946 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-28b1a10a-0c8e-4379-a707-d3fe18e0fe36 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] 10.222.0.46 "GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0" status: 200 len: 1315 microversion: 2.1 time: 0.256752 Nov 16 16:04:23.201512 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 38/73] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:22 2021] GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0 => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:23.514140 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-d0b91cc4-1ce4-4a95-8b7e-ac8baf4fc322 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:23.514668 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-d0b91cc4-1ce4-4a95-8b7e-ac8baf4fc322 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:23.521243 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d0b91cc4-1ce4-4a95-8b7e-ac8baf4fc322 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:23.521692 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d0b91cc4-1ce4-4a95-8b7e-ac8baf4fc322 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:23.522471 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d0b91cc4-1ce4-4a95-8b7e-ac8baf4fc322 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:23.522902 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d0b91cc4-1ce4-4a95-8b7e-ac8baf4fc322 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:23.534872 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-877b07aa-d385-4dfb-aadd-fdf7f90ff64b tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:23.535717 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-877b07aa-d385-4dfb-aadd-fdf7f90ff64b tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:23.541479 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-877b07aa-d385-4dfb-aadd-fdf7f90ff64b tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:23.541930 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-877b07aa-d385-4dfb-aadd-fdf7f90ff64b tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:23.542706 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-877b07aa-d385-4dfb-aadd-fdf7f90ff64b tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:23.543173 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-877b07aa-d385-4dfb-aadd-fdf7f90ff64b tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:23.585007 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-d0b91cc4-1ce4-4a95-8b7e-ac8baf4fc322 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:23.592162 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-d0b91cc4-1ce4-4a95-8b7e-ac8baf4fc322 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1295 microversion: 2.1 time: 0.081729 Nov 16 16:04:23.592729 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 36/74] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:23 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1295 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:23.682503 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-877b07aa-d385-4dfb-aadd-fdf7f90ff64b tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:23.689896 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-877b07aa-d385-4dfb-aadd-fdf7f90ff64b tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248" status: 200 len: 1322 microversion: 2.1 time: 0.159437 Nov 16 16:04:23.690472 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 39/75] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:23 2021] GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:04:24.192218 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-70a55c3b-a445-47e7-b5cd-f9c3b959fcbd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:24.192837 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-70a55c3b-a445-47e7-b5cd-f9c3b959fcbd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:24.198621 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-70a55c3b-a445-47e7-b5cd-f9c3b959fcbd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:24.199070 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-70a55c3b-a445-47e7-b5cd-f9c3b959fcbd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:24.199875 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-70a55c3b-a445-47e7-b5cd-f9c3b959fcbd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:24.200320 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-70a55c3b-a445-47e7-b5cd-f9c3b959fcbd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:24.218202 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7d246af8-7df0-48f5-b2d8-06824307cf03 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:24.219028 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-7d246af8-7df0-48f5-b2d8-06824307cf03 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] [instance: d8c53b20-4a71-421c-b123-bd5f6ccc6fe0] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:24.224885 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7d246af8-7df0-48f5-b2d8-06824307cf03 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:24.225395 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7d246af8-7df0-48f5-b2d8-06824307cf03 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:24.226169 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7d246af8-7df0-48f5-b2d8-06824307cf03 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:24.226603 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7d246af8-7df0-48f5-b2d8-06824307cf03 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:24.259430 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-70a55c3b-a445-47e7-b5cd-f9c3b959fcbd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:24.268066 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-70a55c3b-a445-47e7-b5cd-f9c3b959fcbd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:24.269590 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-70a55c3b-a445-47e7-b5cd-f9c3b959fcbd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:24.270687 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-70a55c3b-a445-47e7-b5cd-f9c3b959fcbd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1333 microversion: 2.20 time: 0.082256 Nov 16 16:04:24.271247 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 37/76] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:04:24 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1333 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:04:24.358119 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7d246af8-7df0-48f5-b2d8-06824307cf03 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697a7c6cbf144a6d9d8594b9c8553c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565c2a8ebcd14908b53a63401ebcb81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:24.365795 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-7d246af8-7df0-48f5-b2d8-06824307cf03 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] 10.222.0.46 "GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0" status: 200 len: 1315 microversion: 2.1 time: 0.151632 Nov 16 16:04:24.366363 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 40/77] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:24 2021] GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:04:24.610477 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-38f04005-0ab2-4bc7-a632-0ab716d51c93 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:24.611080 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-38f04005-0ab2-4bc7-a632-0ab716d51c93 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:24.616947 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-38f04005-0ab2-4bc7-a632-0ab716d51c93 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:24.617398 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-38f04005-0ab2-4bc7-a632-0ab716d51c93 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:24.618167 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-38f04005-0ab2-4bc7-a632-0ab716d51c93 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:24.618609 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-38f04005-0ab2-4bc7-a632-0ab716d51c93 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:24.677463 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-38f04005-0ab2-4bc7-a632-0ab716d51c93 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:24.684566 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-38f04005-0ab2-4bc7-a632-0ab716d51c93 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1295 microversion: 2.1 time: 0.078264 Nov 16 16:04:24.685119 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 38/78] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:24 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1295 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:24.706030 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1b23017b-db25-4f2f-b5bb-d2e2afd42f1e tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:24.706638 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1b23017b-db25-4f2f-b5bb-d2e2afd42f1e tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:24.712424 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1b23017b-db25-4f2f-b5bb-d2e2afd42f1e tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:24.712856 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1b23017b-db25-4f2f-b5bb-d2e2afd42f1e tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:24.713622 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1b23017b-db25-4f2f-b5bb-d2e2afd42f1e tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:24.714062 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1b23017b-db25-4f2f-b5bb-d2e2afd42f1e tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:24.848283 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1b23017b-db25-4f2f-b5bb-d2e2afd42f1e tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:24.855503 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1b23017b-db25-4f2f-b5bb-d2e2afd42f1e tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248" status: 200 len: 1322 microversion: 2.1 time: 0.153394 Nov 16 16:04:24.856056 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 41/79] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:24 2021] GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:25.289636 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-83329685-2ce9-4cfc-b465-ec6da185babf tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:25.290243 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-83329685-2ce9-4cfc-b465-ec6da185babf tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:25.296018 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-83329685-2ce9-4cfc-b465-ec6da185babf tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:25.296458 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-83329685-2ce9-4cfc-b465-ec6da185babf tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:25.297402 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-83329685-2ce9-4cfc-b465-ec6da185babf tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:25.298101 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-83329685-2ce9-4cfc-b465-ec6da185babf tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:25.356699 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-83329685-2ce9-4cfc-b465-ec6da185babf tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:25.364371 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-83329685-2ce9-4cfc-b465-ec6da185babf tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:25.365852 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-83329685-2ce9-4cfc-b465-ec6da185babf tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:25.366925 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-83329685-2ce9-4cfc-b465-ec6da185babf tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1333 microversion: 2.20 time: 0.081019 Nov 16 16:04:25.367503 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 39/80] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:04:25 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1333 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:04:25.381921 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0a6315f6-9dae-492e-9d5c-769dab1b4e8e tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:25.382520 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0a6315f6-9dae-492e-9d5c-769dab1b4e8e tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] [instance: d8c53b20-4a71-421c-b123-bd5f6ccc6fe0] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:25.388223 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0a6315f6-9dae-492e-9d5c-769dab1b4e8e tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:25.388668 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0a6315f6-9dae-492e-9d5c-769dab1b4e8e tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:25.389424 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0a6315f6-9dae-492e-9d5c-769dab1b4e8e tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:25.389847 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0a6315f6-9dae-492e-9d5c-769dab1b4e8e tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:25.519605 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0a6315f6-9dae-492e-9d5c-769dab1b4e8e tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697a7c6cbf144a6d9d8594b9c8553c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565c2a8ebcd14908b53a63401ebcb81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:25.527019 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0a6315f6-9dae-492e-9d5c-769dab1b4e8e tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] 10.222.0.46 "GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0" status: 200 len: 1315 microversion: 2.1 time: 0.148632 Nov 16 16:04:25.527856 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 42/81] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:25 2021] GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:25.702972 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-31cd25c6-6fe1-41a1-9c29-3bcd04d48983 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:25.704456 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-31cd25c6-6fe1-41a1-9c29-3bcd04d48983 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:25.712283 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-31cd25c6-6fe1-41a1-9c29-3bcd04d48983 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:25.712749 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-31cd25c6-6fe1-41a1-9c29-3bcd04d48983 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:25.713546 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-31cd25c6-6fe1-41a1-9c29-3bcd04d48983 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:25.714046 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-31cd25c6-6fe1-41a1-9c29-3bcd04d48983 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:25.804636 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-31cd25c6-6fe1-41a1-9c29-3bcd04d48983 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:25.814847 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-31cd25c6-6fe1-41a1-9c29-3bcd04d48983 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1293 microversion: 2.1 time: 0.116004 Nov 16 16:04:25.815429 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 40/82] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:25 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1293 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:25.873999 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1fd184ed-cfc6-40b5-a3e7-f7c489d692c7 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:25.874715 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1fd184ed-cfc6-40b5-a3e7-f7c489d692c7 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:25.881775 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1fd184ed-cfc6-40b5-a3e7-f7c489d692c7 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:25.882250 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1fd184ed-cfc6-40b5-a3e7-f7c489d692c7 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:25.883173 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1fd184ed-cfc6-40b5-a3e7-f7c489d692c7 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:25.883648 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1fd184ed-cfc6-40b5-a3e7-f7c489d692c7 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:26.267563 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1fd184ed-cfc6-40b5-a3e7-f7c489d692c7 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:26.280304 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1fd184ed-cfc6-40b5-a3e7-f7c489d692c7 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248" status: 200 len: 1322 microversion: 2.1 time: 0.410601 Nov 16 16:04:26.280720 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 43/83] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:25 2021] GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248 => generated 1322 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:26.393126 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-6ad16e27-0858-4b92-a23f-1063aff028ec tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:26.394691 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-6ad16e27-0858-4b92-a23f-1063aff028ec tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:26.417822 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6ad16e27-0858-4b92-a23f-1063aff028ec tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:26.419791 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6ad16e27-0858-4b92-a23f-1063aff028ec tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:26.424118 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6ad16e27-0858-4b92-a23f-1063aff028ec tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:26.426303 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6ad16e27-0858-4b92-a23f-1063aff028ec tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:26.544683 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-17f43a75-0c03-4c46-b249-346fdeed0b12 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:26.545302 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-17f43a75-0c03-4c46-b249-346fdeed0b12 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] [instance: d8c53b20-4a71-421c-b123-bd5f6ccc6fe0] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:26.553476 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-17f43a75-0c03-4c46-b249-346fdeed0b12 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:26.553927 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-17f43a75-0c03-4c46-b249-346fdeed0b12 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:26.555935 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-17f43a75-0c03-4c46-b249-346fdeed0b12 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:26.556551 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-17f43a75-0c03-4c46-b249-346fdeed0b12 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:26.632950 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-6ad16e27-0858-4b92-a23f-1063aff028ec tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:26.644145 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-6ad16e27-0858-4b92-a23f-1063aff028ec tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:26.645946 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-6ad16e27-0858-4b92-a23f-1063aff028ec tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:26.647644 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-6ad16e27-0858-4b92-a23f-1063aff028ec tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1339 microversion: 2.20 time: 0.265862 Nov 16 16:04:26.648415 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 41/84] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:04:26 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1339 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:04:26.836875 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-c722582e-8b87-41fc-9630-beb53119235c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:26.837685 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-c722582e-8b87-41fc-9630-beb53119235c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:26.841778 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-17f43a75-0c03-4c46-b249-346fdeed0b12 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697a7c6cbf144a6d9d8594b9c8553c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565c2a8ebcd14908b53a63401ebcb81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:26.850752 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-17f43a75-0c03-4c46-b249-346fdeed0b12 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] 10.222.0.46 "GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0" status: 200 len: 1315 microversion: 2.1 time: 0.309609 Nov 16 16:04:26.851316 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 44/85] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:26 2021] GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0 => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:26.852561 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c722582e-8b87-41fc-9630-beb53119235c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:26.853587 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c722582e-8b87-41fc-9630-beb53119235c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:26.854632 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c722582e-8b87-41fc-9630-beb53119235c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:26.856878 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c722582e-8b87-41fc-9630-beb53119235c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:26.947244 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-c722582e-8b87-41fc-9630-beb53119235c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:26.965241 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-c722582e-8b87-41fc-9630-beb53119235c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1293 microversion: 2.1 time: 0.135369 Nov 16 16:04:26.966180 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 42/86] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:26 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1293 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:27.295589 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-1bac6bc4-d4d6-44f1-ae00-fc13381ce360 req-ccd1d48c-3b5e-43af-9445-9403c7d235ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8c53b20-4a71-421c-b123-bd5f6ccc6fe0", "name": "network-vif-plugged", "status": "completed", "tag": "4ac187bb-10df-4230-9320-5556a334a54d"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:04:27.298516 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-a8452007-bb52-4867-b8ed-0d40e66e2e1d tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:27.299265 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:04:27.299265 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Nov 16 16:04:27.299698 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-a8452007-bb52-4867-b8ed-0d40e66e2e1d tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:27.311126 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a8452007-bb52-4867-b8ed-0d40e66e2e1d tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:27.312707 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a8452007-bb52-4867-b8ed-0d40e66e2e1d tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:27.316680 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a8452007-bb52-4867-b8ed-0d40e66e2e1d tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:27.317463 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a8452007-bb52-4867-b8ed-0d40e66e2e1d tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:27.327545 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-1bac6bc4-d4d6-44f1-ae00-fc13381ce360 req-ccd1d48c-3b5e-43af-9445-9403c7d235ff service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:27.328200 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-1bac6bc4-d4d6-44f1-ae00-fc13381ce360 req-ccd1d48c-3b5e-43af-9445-9403c7d235ff service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:27.364517 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-1bac6bc4-d4d6-44f1-ae00-fc13381ce360 req-ccd1d48c-3b5e-43af-9445-9403c7d235ff service nova] Creating event network-vif-plugged:4ac187bb-10df-4230-9320-5556a334a54d for instance d8c53b20-4a71-421c-b123-bd5f6ccc6fe0 on hv-cinder-81809 Nov 16 16:04:27.365680 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-1bac6bc4-d4d6-44f1-ae00-fc13381ce360 req-ccd1d48c-3b5e-43af-9445-9403c7d235ff service nova] Acquired lock "compute-rpcapi-router" {{(pid=116084) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 16 16:04:27.367063 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b23e3c11-6d4f-4c8b-8317-05f00073334d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:27.367739 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b23e3c11-6d4f-4c8b-8317-05f00073334d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:27.371759 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b23e3c11-6d4f-4c8b-8317-05f00073334d None None] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:27.372445 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b23e3c11-6d4f-4c8b-8317-05f00073334d None None] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:27.384946 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.compute.rpcapi [None req-b23e3c11-6d4f-4c8b-8317-05f00073334d None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 16 16:04:27.386532 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b23e3c11-6d4f-4c8b-8317-05f00073334d None None] Releasing lock "compute-rpcapi-router" {{(pid=116084) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 16 16:04:27.415728 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b23e3c11-6d4f-4c8b-8317-05f00073334d None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.293216 Nov 16 16:04:27.417301 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 45/87] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:04:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:04:27.669983 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-058cfc28-9340-46b4-adeb-29dc0e69e893 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:27.671627 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-058cfc28-9340-46b4-adeb-29dc0e69e893 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:27.681233 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-058cfc28-9340-46b4-adeb-29dc0e69e893 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:27.682034 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-058cfc28-9340-46b4-adeb-29dc0e69e893 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:27.683412 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-058cfc28-9340-46b4-adeb-29dc0e69e893 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:27.688663 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-058cfc28-9340-46b4-adeb-29dc0e69e893 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:27.975831 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-a8452007-bb52-4867-b8ed-0d40e66e2e1d tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:27.986259 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-a8452007-bb52-4867-b8ed-0d40e66e2e1d tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248" status: 200 len: 1322 microversion: 2.1 time: 0.691958 Nov 16 16:04:27.991566 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 43/88] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:27 2021] GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248 => generated 1322 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:27.999754 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-dde25c0e-de59-406d-8a1c-cf98b0f2847a tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:28.006140 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-dde25c0e-de59-406d-8a1c-cf98b0f2847a tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] [instance: d8c53b20-4a71-421c-b123-bd5f6ccc6fe0] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:28.021898 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-dde25c0e-de59-406d-8a1c-cf98b0f2847a tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:28.022645 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-dde25c0e-de59-406d-8a1c-cf98b0f2847a tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:28.023857 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-dde25c0e-de59-406d-8a1c-cf98b0f2847a tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:28.024472 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-dde25c0e-de59-406d-8a1c-cf98b0f2847a tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:28.655044 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-058cfc28-9340-46b4-adeb-29dc0e69e893 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:28.666474 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-058cfc28-9340-46b4-adeb-29dc0e69e893 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:28.669418 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-058cfc28-9340-46b4-adeb-29dc0e69e893 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:28.672152 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-058cfc28-9340-46b4-adeb-29dc0e69e893 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1407 microversion: 2.20 time: 1.007551 Nov 16 16:04:28.676410 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 46/89] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:04:27 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1407 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:04:28.694002 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-4be167cc-d8b2-4b56-a904-18d953f0b658 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:28.694868 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-4be167cc-d8b2-4b56-a904-18d953f0b658 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:28.701373 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4be167cc-d8b2-4b56-a904-18d953f0b658 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:28.702094 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4be167cc-d8b2-4b56-a904-18d953f0b658 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:28.703367 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4be167cc-d8b2-4b56-a904-18d953f0b658 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:28.706708 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4be167cc-d8b2-4b56-a904-18d953f0b658 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:29.014711 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-dde25c0e-de59-406d-8a1c-cf98b0f2847a tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697a7c6cbf144a6d9d8594b9c8553c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565c2a8ebcd14908b53a63401ebcb81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:29.022718 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-dde25c0e-de59-406d-8a1c-cf98b0f2847a tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] 10.222.0.46 "GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0" status: 200 len: 1315 microversion: 2.1 time: 1.029654 Nov 16 16:04:29.026069 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 44/90] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:27 2021] GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0 => generated 1315 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:29.041419 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-9ccaede6-e9c8-483e-a349-87f31415c322 req-05a8ad79-89b1-4b59-a233-9d1b9df4dff0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6447972e-6291-4e68-8271-c93523206230", "tag": "68ede3d7-0ef4-42a4-b3de-ef6046161db6"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:04:29.043339 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:04:29.043339 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Nov 16 16:04:29.056537 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-9ccaede6-e9c8-483e-a349-87f31415c322 req-05a8ad79-89b1-4b59-a233-9d1b9df4dff0 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:29.057313 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-9ccaede6-e9c8-483e-a349-87f31415c322 req-05a8ad79-89b1-4b59-a233-9d1b9df4dff0 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:29.075033 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-9ccaede6-e9c8-483e-a349-87f31415c322 req-05a8ad79-89b1-4b59-a233-9d1b9df4dff0 service nova] Creating event network-changed:68ede3d7-0ef4-42a4-b3de-ef6046161db6 for instance 6447972e-6291-4e68-8271-c93523206230 on hv-cinder-81809 Nov 16 16:04:29.080583 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-9ccaede6-e9c8-483e-a349-87f31415c322 req-05a8ad79-89b1-4b59-a233-9d1b9df4dff0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042888 Nov 16 16:04:29.081712 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 45/91] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:04:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:04:29.091760 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-afb0695d-3f7d-4f2e-99df-ccd69bd08532 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:29.093312 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-afb0695d-3f7d-4f2e-99df-ccd69bd08532 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:29.108753 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-afb0695d-3f7d-4f2e-99df-ccd69bd08532 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:29.109991 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-afb0695d-3f7d-4f2e-99df-ccd69bd08532 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:29.111193 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-afb0695d-3f7d-4f2e-99df-ccd69bd08532 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:29.111843 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-afb0695d-3f7d-4f2e-99df-ccd69bd08532 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:29.307245 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-4be167cc-d8b2-4b56-a904-18d953f0b658 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:29.315847 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-4be167cc-d8b2-4b56-a904-18d953f0b658 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1361 microversion: 2.1 time: 0.638094 Nov 16 16:04:29.316772 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 47/92] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:28 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1361 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:29.437100 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-9cd93b0c-c1c8-4f0b-809e-3904694396a6 req-6e11460a-90b6-4c35-ae60-2f49bfcd712f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69df60e2-42c9-4caa-abdc-a7ecb61d8d73", "name": "network-vif-plugged", "status": "completed", "tag": "8d515f5e-ebe4-404a-a99d-1abd2b9d5bcc"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:04:29.440445 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:04:29.440445 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Nov 16 16:04:29.450065 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-9cd93b0c-c1c8-4f0b-809e-3904694396a6 req-6e11460a-90b6-4c35-ae60-2f49bfcd712f service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:29.451690 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-9cd93b0c-c1c8-4f0b-809e-3904694396a6 req-6e11460a-90b6-4c35-ae60-2f49bfcd712f service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:29.509580 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-9cd93b0c-c1c8-4f0b-809e-3904694396a6 req-6e11460a-90b6-4c35-ae60-2f49bfcd712f service nova] Creating event network-vif-plugged:8d515f5e-ebe4-404a-a99d-1abd2b9d5bcc for instance 69df60e2-42c9-4caa-abdc-a7ecb61d8d73 on hv-cinder-81809 Nov 16 16:04:29.530524 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-9cd93b0c-c1c8-4f0b-809e-3904694396a6 req-6e11460a-90b6-4c35-ae60-2f49bfcd712f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096432 Nov 16 16:04:29.537504 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 48/93] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:04:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:04:29.586718 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-afb0695d-3f7d-4f2e-99df-ccd69bd08532 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:29.602770 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-afb0695d-3f7d-4f2e-99df-ccd69bd08532 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248" status: 200 len: 1322 microversion: 2.1 time: 0.519221 Nov 16 16:04:29.612947 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 46/94] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:29 2021] GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248 => generated 1322 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:29.700271 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-89dbb080-3b81-4f20-9e7b-1992d7f65502 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:29.702390 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-89dbb080-3b81-4f20-9e7b-1992d7f65502 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:29.733705 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-89dbb080-3b81-4f20-9e7b-1992d7f65502 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:29.733904 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-89dbb080-3b81-4f20-9e7b-1992d7f65502 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:29.736828 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-89dbb080-3b81-4f20-9e7b-1992d7f65502 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:29.737409 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-89dbb080-3b81-4f20-9e7b-1992d7f65502 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:29.824737 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-49d7a964-10de-4f8a-9e1b-7955aa082daf req-e8d6d906-1ab9-4cc7-88fe-a5eca3bd4838 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "674c9e04-e56c-4891-adc1-7cdac0c8510f", "tag": "07aae0fa-265c-47a8-af4f-ea385dbee127"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:04:29.833008 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:04:29.833008 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Nov 16 16:04:29.860538 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-49d7a964-10de-4f8a-9e1b-7955aa082daf req-e8d6d906-1ab9-4cc7-88fe-a5eca3bd4838 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:29.861228 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-49d7a964-10de-4f8a-9e1b-7955aa082daf req-e8d6d906-1ab9-4cc7-88fe-a5eca3bd4838 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:29.898136 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-49d7a964-10de-4f8a-9e1b-7955aa082daf req-e8d6d906-1ab9-4cc7-88fe-a5eca3bd4838 service nova] Creating event network-changed:07aae0fa-265c-47a8-af4f-ea385dbee127 for instance 674c9e04-e56c-4891-adc1-7cdac0c8510f on hv-cinder-81809 Nov 16 16:04:29.912296 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-49d7a964-10de-4f8a-9e1b-7955aa082daf req-e8d6d906-1ab9-4cc7-88fe-a5eca3bd4838 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092401 Nov 16 16:04:29.915076 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 47/95] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:04:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:04:30.044150 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-7b2481d1-68e3-42e1-9e7c-c953a21aee62 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:30.044860 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-7b2481d1-68e3-42e1-9e7c-c953a21aee62 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] [instance: d8c53b20-4a71-421c-b123-bd5f6ccc6fe0] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:30.054334 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7b2481d1-68e3-42e1-9e7c-c953a21aee62 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:30.061779 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7b2481d1-68e3-42e1-9e7c-c953a21aee62 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:30.063412 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7b2481d1-68e3-42e1-9e7c-c953a21aee62 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:30.064604 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7b2481d1-68e3-42e1-9e7c-c953a21aee62 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:30.362621 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-89dbb080-3b81-4f20-9e7b-1992d7f65502 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:30.377145 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-89dbb080-3b81-4f20-9e7b-1992d7f65502 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:30.378829 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-89dbb080-3b81-4f20-9e7b-1992d7f65502 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:30.380529 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-89dbb080-3b81-4f20-9e7b-1992d7f65502 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1407 microversion: 2.20 time: 0.689451 Nov 16 16:04:30.386092 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 49/96] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:04:29 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1407 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:04:30.408985 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-66ffc74f-a317-40b1-9cd7-c77139500b01 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:30.411210 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-66ffc74f-a317-40b1-9cd7-c77139500b01 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:30.439812 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-66ffc74f-a317-40b1-9cd7-c77139500b01 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:30.440755 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-66ffc74f-a317-40b1-9cd7-c77139500b01 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:30.444240 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-66ffc74f-a317-40b1-9cd7-c77139500b01 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:30.444887 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-66ffc74f-a317-40b1-9cd7-c77139500b01 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:30.501882 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-7b2481d1-68e3-42e1-9e7c-c953a21aee62 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697a7c6cbf144a6d9d8594b9c8553c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565c2a8ebcd14908b53a63401ebcb81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:30.509618 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-7b2481d1-68e3-42e1-9e7c-c953a21aee62 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] 10.222.0.46 "GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0" status: 200 len: 1315 microversion: 2.1 time: 0.469447 Nov 16 16:04:30.510202 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 48/97] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:30 2021] GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0 => generated 1315 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:04:30.621265 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-77cfa082-0783-4e5f-810d-f9aad8a50604 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:30.622369 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-77cfa082-0783-4e5f-810d-f9aad8a50604 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:30.634622 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-77cfa082-0783-4e5f-810d-f9aad8a50604 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:30.635191 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-77cfa082-0783-4e5f-810d-f9aad8a50604 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:30.636365 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-77cfa082-0783-4e5f-810d-f9aad8a50604 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:30.637664 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-77cfa082-0783-4e5f-810d-f9aad8a50604 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:30.677741 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-66ffc74f-a317-40b1-9cd7-c77139500b01 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:30.686106 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-66ffc74f-a317-40b1-9cd7-c77139500b01 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1361 microversion: 2.1 time: 0.298573 Nov 16 16:04:30.689662 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 50/98] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:30 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1361 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:31.002445 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-77cfa082-0783-4e5f-810d-f9aad8a50604 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:31.012270 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-77cfa082-0783-4e5f-810d-f9aad8a50604 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248" status: 200 len: 1322 microversion: 2.1 time: 0.395148 Nov 16 16:04:31.012967 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 49/99] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:30 2021] GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248 => generated 1322 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:31.403698 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-32c7b5ab-580d-4483-8a97-3d8b63b84505 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:31.404870 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-32c7b5ab-580d-4483-8a97-3d8b63b84505 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:31.416841 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-32c7b5ab-580d-4483-8a97-3d8b63b84505 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:31.418443 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-32c7b5ab-580d-4483-8a97-3d8b63b84505 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:31.421176 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-32c7b5ab-580d-4483-8a97-3d8b63b84505 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:31.423002 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-32c7b5ab-580d-4483-8a97-3d8b63b84505 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:31.533018 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-e48a0aa1-7883-48fc-9165-765dc56e91c9 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:31.534160 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-e48a0aa1-7883-48fc-9165-765dc56e91c9 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] [instance: d8c53b20-4a71-421c-b123-bd5f6ccc6fe0] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:31.550434 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e48a0aa1-7883-48fc-9165-765dc56e91c9 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:31.551331 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e48a0aa1-7883-48fc-9165-765dc56e91c9 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:31.553469 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e48a0aa1-7883-48fc-9165-765dc56e91c9 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:31.554141 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e48a0aa1-7883-48fc-9165-765dc56e91c9 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:31.861765 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-32c7b5ab-580d-4483-8a97-3d8b63b84505 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:31.887104 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-32c7b5ab-580d-4483-8a97-3d8b63b84505 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:31.889095 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-32c7b5ab-580d-4483-8a97-3d8b63b84505 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:31.890507 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-32c7b5ab-580d-4483-8a97-3d8b63b84505 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1407 microversion: 2.20 time: 0.491231 Nov 16 16:04:31.892268 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 51/100] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:04:31 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1407 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:04:31.897735 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-1191f1af-6f9b-41cc-8025-984642d06d16 req-ebad4eaf-268a-4b91-89b6-036563c2812e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78398054-0c37-4dfb-8926-a199cdf30248", "name": "network-vif-plugged", "status": "completed", "tag": "79ddbfbc-87d6-4cbb-8ab7-1840fe13a61a"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:04:31.899455 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:04:31.899455 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Nov 16 16:04:31.908987 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-1191f1af-6f9b-41cc-8025-984642d06d16 req-ebad4eaf-268a-4b91-89b6-036563c2812e service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:31.909599 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-1191f1af-6f9b-41cc-8025-984642d06d16 req-ebad4eaf-268a-4b91-89b6-036563c2812e service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:31.930974 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-1191f1af-6f9b-41cc-8025-984642d06d16 req-ebad4eaf-268a-4b91-89b6-036563c2812e service nova] Creating event network-vif-plugged:79ddbfbc-87d6-4cbb-8ab7-1840fe13a61a for instance 78398054-0c37-4dfb-8926-a199cdf30248 on hv-cinder-81809 Nov 16 16:04:31.943102 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-1191f1af-6f9b-41cc-8025-984642d06d16 req-ebad4eaf-268a-4b91-89b6-036563c2812e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049213 Nov 16 16:04:31.944336 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 52/101] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:04:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:04:31.972809 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-be0d0f95-5923-4b99-a875-b8fd97773fd7 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:31.973790 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-be0d0f95-5923-4b99-a875-b8fd97773fd7 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:31.988390 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-be0d0f95-5923-4b99-a875-b8fd97773fd7 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:31.989292 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-be0d0f95-5923-4b99-a875-b8fd97773fd7 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:31.992204 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-be0d0f95-5923-4b99-a875-b8fd97773fd7 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:31.992812 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-be0d0f95-5923-4b99-a875-b8fd97773fd7 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:32.103713 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-e48a0aa1-7883-48fc-9165-765dc56e91c9 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697a7c6cbf144a6d9d8594b9c8553c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565c2a8ebcd14908b53a63401ebcb81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:32.114003 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-e48a0aa1-7883-48fc-9165-765dc56e91c9 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] 10.222.0.46 "GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0" status: 200 len: 1502 microversion: 2.1 time: 0.590912 Nov 16 16:04:32.114414 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 50/102] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:31 2021] GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0 => generated 1502 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:04:32.120159 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-155a9fb3-4935-46e1-b77f-543a69d6e10f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:32.121456 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-155a9fb3-4935-46e1-b77f-543a69d6e10f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:32.151180 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-155a9fb3-4935-46e1-b77f-543a69d6e10f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:32.151732 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-155a9fb3-4935-46e1-b77f-543a69d6e10f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:32.153406 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-155a9fb3-4935-46e1-b77f-543a69d6e10f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:32.153888 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-155a9fb3-4935-46e1-b77f-543a69d6e10f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:32.269286 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-be0d0f95-5923-4b99-a875-b8fd97773fd7 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:32.276609 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-be0d0f95-5923-4b99-a875-b8fd97773fd7 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1361 microversion: 2.1 time: 0.326741 Nov 16 16:04:32.277195 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 53/103] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:31 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1361 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:32.355365 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-155a9fb3-4935-46e1-b77f-543a69d6e10f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:32.365342 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-155a9fb3-4935-46e1-b77f-543a69d6e10f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248" status: 200 len: 1322 microversion: 2.1 time: 0.248829 Nov 16 16:04:32.366926 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 51/104] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:32 2021] GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248 => generated 1322 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:32.909833 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-61f991ca-3d57-4049-94b7-2dd154ff96da tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:32.910441 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-61f991ca-3d57-4049-94b7-2dd154ff96da tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:32.921247 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-61f991ca-3d57-4049-94b7-2dd154ff96da tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:32.922433 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-61f991ca-3d57-4049-94b7-2dd154ff96da tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:32.924538 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-61f991ca-3d57-4049-94b7-2dd154ff96da tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:32.925152 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-61f991ca-3d57-4049-94b7-2dd154ff96da tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:33.085854 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-61f991ca-3d57-4049-94b7-2dd154ff96da tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:33.094523 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-61f991ca-3d57-4049-94b7-2dd154ff96da tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:33.096139 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-61f991ca-3d57-4049-94b7-2dd154ff96da tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:33.097253 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-61f991ca-3d57-4049-94b7-2dd154ff96da tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1407 microversion: 2.20 time: 0.191774 Nov 16 16:04:33.098032 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 54/105] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:04:32 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:04:33.241529 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-975ac952-a486-4fbd-8ebb-8eec7f0556f4 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-150449767", "imageRef": "7c3bd8e0-8d7e-4cf7-90db-742c4f55e405", "flavorRef": "452"}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:04:33.295052 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-48c0e1b5-ee4c-4ebc-b739-fa2fda579623 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:33.295702 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-48c0e1b5-ee4c-4ebc-b739-fa2fda579623 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:33.309385 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.network.neutron [None req-975ac952-a486-4fbd-8ebb-8eec7f0556f4 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] validate_networks() for None {{(pid=116085) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 16:04:33.315839 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-48c0e1b5-ee4c-4ebc-b739-fa2fda579623 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:33.316446 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-48c0e1b5-ee4c-4ebc-b739-fa2fda579623 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:33.317395 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-48c0e1b5-ee4c-4ebc-b739-fa2fda579623 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:33.317924 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-48c0e1b5-ee4c-4ebc-b739-fa2fda579623 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:33.832687 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-48c0e1b5-ee4c-4ebc-b739-fa2fda579623 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:33.840459 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-48c0e1b5-ee4c-4ebc-b739-fa2fda579623 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1361 microversion: 2.1 time: 0.549901 Nov 16 16:04:33.847521 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 55/106] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:33 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1361 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:04:33.847521 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-62c953fb-7a0f-4ff2-9d38-09c75565fd22 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:33.847521 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-62c953fb-7a0f-4ff2-9d38-09c75565fd22 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:33.853903 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-62c953fb-7a0f-4ff2-9d38-09c75565fd22 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:33.854447 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-62c953fb-7a0f-4ff2-9d38-09c75565fd22 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:33.855266 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-62c953fb-7a0f-4ff2-9d38-09c75565fd22 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:33.855732 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-62c953fb-7a0f-4ff2-9d38-09c75565fd22 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:33.869692 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-975ac952-a486-4fbd-8ebb-8eec7f0556f4 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Flavor limits 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 16:04:33.870113 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-975ac952-a486-4fbd-8ebb-8eec7f0556f4 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Image limits 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 16:04:33.870605 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-975ac952-a486-4fbd-8ebb-8eec7f0556f4 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Flavor pref 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 16:04:33.872027 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-975ac952-a486-4fbd-8ebb-8eec7f0556f4 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Image pref 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 16:04:33.872580 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-975ac952-a486-4fbd-8ebb-8eec7f0556f4 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 16:04:33.883547 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-975ac952-a486-4fbd-8ebb-8eec7f0556f4 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:33.884402 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-975ac952-a486-4fbd-8ebb-8eec7f0556f4 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:33.885374 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-975ac952-a486-4fbd-8ebb-8eec7f0556f4 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:33.885974 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-975ac952-a486-4fbd-8ebb-8eec7f0556f4 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:33.904898 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-975ac952-a486-4fbd-8ebb-8eec7f0556f4 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Getting quotas for project 52edf438b5b545dfaa8dcdba31441017. Resources: {'instances', 'ram', 'cores'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:04:33.910086 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-975ac952-a486-4fbd-8ebb-8eec7f0556f4 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Getting quotas for user baeb57cceead4eda9ec354d996c7876c and project 52edf438b5b545dfaa8dcdba31441017. Resources: {'instances', 'ram', 'cores'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:04:33.921030 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-975ac952-a486-4fbd-8ebb-8eec7f0556f4 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Going to run 1 instances... {{(pid=116085) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 16:04:33.924277 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-975ac952-a486-4fbd-8ebb-8eec7f0556f4 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] [instance: fe8f46c2-6a46-484f-8b50-29407c7207c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c3bd8e0-8d7e-4cf7-90db-742c4f55e405',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116085) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 16:04:33.971927 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-975ac952-a486-4fbd-8ebb-8eec7f0556f4 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.734496 Nov 16 16:04:33.972571 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 52/107] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 16 16:04:33 2021] POST /compute/v2.1/servers => generated 380 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 16:04:33.977856 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-1161afb0-dcac-40fe-9656-f23b72a47bc9 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e813c7c3-90a5-4e3e-8f2e-b1fb48735f50"}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:04:33.979169 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-1161afb0-dcac-40fe-9656-f23b72a47bc9 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] [instance: d8c53b20-4a71-421c-b123-bd5f6ccc6fe0] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:33.987326 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1161afb0-dcac-40fe-9656-f23b72a47bc9 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:33.987965 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1161afb0-dcac-40fe-9656-f23b72a47bc9 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:33.988909 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1161afb0-dcac-40fe-9656-f23b72a47bc9 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:33.989482 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1161afb0-dcac-40fe-9656-f23b72a47bc9 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:34.024920 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-62c953fb-7a0f-4ff2-9d38-09c75565fd22 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:34.033053 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-62c953fb-7a0f-4ff2-9d38-09c75565fd22 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248" status: 200 len: 1322 microversion: 2.1 time: 0.190892 Nov 16 16:04:34.033643 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 56/108] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:33 2021] GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248 => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:34.049001 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ded2d962-956e-46f0-bee0-38579bf07838 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:34.050041 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ded2d962-956e-46f0-bee0-38579bf07838 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] [instance: fe8f46c2-6a46-484f-8b50-29407c7207c7] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:34.111385 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ded2d962-956e-46f0-bee0-38579bf07838 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baeb57cceead4eda9ec354d996c7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52edf438b5b545dfaa8dcdba31441017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:34.118456 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ded2d962-956e-46f0-bee0-38579bf07838 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] 10.222.0.46 "GET /compute/v2.1/servers/fe8f46c2-6a46-484f-8b50-29407c7207c7" status: 200 len: 1214 microversion: 2.1 time: 0.074219 Nov 16 16:04:34.119348 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 57/109] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:34 2021] GET /compute/v2.1/servers/fe8f46c2-6a46-484f-8b50-29407c7207c7 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:34.134924 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-97664923-f165-4098-9754-df0d2f6f459f tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:34.135629 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-97664923-f165-4098-9754-df0d2f6f459f tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:34.142618 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-97664923-f165-4098-9754-df0d2f6f459f tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:34.143773 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-97664923-f165-4098-9754-df0d2f6f459f tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:34.144758 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-97664923-f165-4098-9754-df0d2f6f459f tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:34.147739 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-97664923-f165-4098-9754-df0d2f6f459f tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:34.374550 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-97664923-f165-4098-9754-df0d2f6f459f tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:34.383718 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-97664923-f165-4098-9754-df0d2f6f459f tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:34.385712 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-97664923-f165-4098-9754-df0d2f6f459f tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:34.387197 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-97664923-f165-4098-9754-df0d2f6f459f tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1407 microversion: 2.20 time: 0.259095 Nov 16 16:04:34.387886 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 58/110] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:04:34 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1407 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:04:34.859508 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-4b69ea79-19a8-45b4-bbd7-9fb293af67ec tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:34.859508 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-4b69ea79-19a8-45b4-bbd7-9fb293af67ec tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:34.864283 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4b69ea79-19a8-45b4-bbd7-9fb293af67ec tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:34.864828 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4b69ea79-19a8-45b4-bbd7-9fb293af67ec tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:34.865719 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4b69ea79-19a8-45b4-bbd7-9fb293af67ec tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:34.866214 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4b69ea79-19a8-45b4-bbd7-9fb293af67ec tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:35.065936 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-4b69ea79-19a8-45b4-bbd7-9fb293af67ec tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:35.073413 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-4b69ea79-19a8-45b4-bbd7-9fb293af67ec tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1361 microversion: 2.1 time: 0.220185 Nov 16 16:04:35.073986 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 59/111] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:34 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1361 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:04:35.078188 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0b7e3e40-8f4b-4b5e-a692-9bcc9bfe06f2 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:35.078785 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0b7e3e40-8f4b-4b5e-a692-9bcc9bfe06f2 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:35.084296 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0b7e3e40-8f4b-4b5e-a692-9bcc9bfe06f2 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:35.084745 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0b7e3e40-8f4b-4b5e-a692-9bcc9bfe06f2 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:35.085518 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0b7e3e40-8f4b-4b5e-a692-9bcc9bfe06f2 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:35.085958 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0b7e3e40-8f4b-4b5e-a692-9bcc9bfe06f2 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:35.222600 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0b7e3e40-8f4b-4b5e-a692-9bcc9bfe06f2 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:35.232971 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0b7e3e40-8f4b-4b5e-a692-9bcc9bfe06f2 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248" status: 200 len: 1322 microversion: 2.1 time: 0.157971 Nov 16 16:04:35.233596 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 60/112] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:35 2021] GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:35.238319 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f77891c9-145f-4487-ad95-37eec1a2121e tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:35.238852 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f77891c9-145f-4487-ad95-37eec1a2121e tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] [instance: fe8f46c2-6a46-484f-8b50-29407c7207c7] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:35.244746 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f77891c9-145f-4487-ad95-37eec1a2121e tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:35.245195 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f77891c9-145f-4487-ad95-37eec1a2121e tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:35.245966 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f77891c9-145f-4487-ad95-37eec1a2121e tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:35.246401 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f77891c9-145f-4487-ad95-37eec1a2121e tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:35.308678 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f77891c9-145f-4487-ad95-37eec1a2121e tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baeb57cceead4eda9ec354d996c7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52edf438b5b545dfaa8dcdba31441017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:35.316626 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f77891c9-145f-4487-ad95-37eec1a2121e tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] 10.222.0.46 "GET /compute/v2.1/servers/fe8f46c2-6a46-484f-8b50-29407c7207c7" status: 200 len: 1218 microversion: 2.1 time: 0.081838 Nov 16 16:04:35.317194 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 61/113] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:35 2021] GET /compute/v2.1/servers/fe8f46c2-6a46-484f-8b50-29407c7207c7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:35.406407 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1ac40c97-ba60-42aa-8cef-5062f25f6e5b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:35.407021 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1ac40c97-ba60-42aa-8cef-5062f25f6e5b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:35.413050 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1ac40c97-ba60-42aa-8cef-5062f25f6e5b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:35.413496 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1ac40c97-ba60-42aa-8cef-5062f25f6e5b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:35.414279 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1ac40c97-ba60-42aa-8cef-5062f25f6e5b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:35.414716 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1ac40c97-ba60-42aa-8cef-5062f25f6e5b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:35.579778 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1ac40c97-ba60-42aa-8cef-5062f25f6e5b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:35.587697 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1ac40c97-ba60-42aa-8cef-5062f25f6e5b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:35.589185 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1ac40c97-ba60-42aa-8cef-5062f25f6e5b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:35.590284 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1ac40c97-ba60-42aa-8cef-5062f25f6e5b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1407 microversion: 2.20 time: 0.188002 Nov 16 16:04:35.590843 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 62/114] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:04:35 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:04:36.100122 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-4651ea47-c3a4-4676-83a7-06485b8e1683 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:36.100910 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-4651ea47-c3a4-4676-83a7-06485b8e1683 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:36.117415 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4651ea47-c3a4-4676-83a7-06485b8e1683 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:36.117875 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4651ea47-c3a4-4676-83a7-06485b8e1683 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:36.121060 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4651ea47-c3a4-4676-83a7-06485b8e1683 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:36.125344 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4651ea47-c3a4-4676-83a7-06485b8e1683 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:36.165211 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-1161afb0-dcac-40fe-9656-f23b72a47bc9 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] 10.222.0.46 "POST /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.190990 Nov 16 16:04:36.165792 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 53/115] 10.222.0.46 () {60 vars in 1322 bytes} [Tue Nov 16 16:04:33 2021] POST /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0/os-volume_attachments => generated 194 bytes in 2193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:04:36.252658 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-abeaa6c0-bfcd-4072-86ba-b0de83364dc6 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:36.254533 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-abeaa6c0-bfcd-4072-86ba-b0de83364dc6 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:36.303870 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-abeaa6c0-bfcd-4072-86ba-b0de83364dc6 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:36.304496 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-abeaa6c0-bfcd-4072-86ba-b0de83364dc6 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:36.305287 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-abeaa6c0-bfcd-4072-86ba-b0de83364dc6 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:36.310667 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-abeaa6c0-bfcd-4072-86ba-b0de83364dc6 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:36.414386 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-4651ea47-c3a4-4676-83a7-06485b8e1683 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:36.421565 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-4651ea47-c3a4-4676-83a7-06485b8e1683 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1361 microversion: 2.1 time: 0.334216 Nov 16 16:04:36.422756 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 63/116] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:36 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1361 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:36.430493 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6fc1d003-1f9b-4f5b-ac5a-40f72e4269e7 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:36.435926 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-6fc1d003-1f9b-4f5b-ac5a-40f72e4269e7 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] [instance: fe8f46c2-6a46-484f-8b50-29407c7207c7] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:36.447599 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6fc1d003-1f9b-4f5b-ac5a-40f72e4269e7 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:36.448049 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6fc1d003-1f9b-4f5b-ac5a-40f72e4269e7 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:36.451444 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6fc1d003-1f9b-4f5b-ac5a-40f72e4269e7 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:36.451955 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6fc1d003-1f9b-4f5b-ac5a-40f72e4269e7 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:36.554610 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-6fc1d003-1f9b-4f5b-ac5a-40f72e4269e7 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baeb57cceead4eda9ec354d996c7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52edf438b5b545dfaa8dcdba31441017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:36.565032 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-6fc1d003-1f9b-4f5b-ac5a-40f72e4269e7 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] 10.222.0.46 "GET /compute/v2.1/servers/fe8f46c2-6a46-484f-8b50-29407c7207c7" status: 200 len: 1266 microversion: 2.1 time: 0.138037 Nov 16 16:04:36.567180 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-abeaa6c0-bfcd-4072-86ba-b0de83364dc6 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:36.568278 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 64/117] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:36 2021] GET /compute/v2.1/servers/fe8f46c2-6a46-484f-8b50-29407c7207c7 => generated 1266 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:36.585425 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-abeaa6c0-bfcd-4072-86ba-b0de83364dc6 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248" status: 200 len: 1516 microversion: 2.1 time: 0.339027 Nov 16 16:04:36.586519 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 54/118] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:36 2021] GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248 => generated 1516 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:04:36.603426 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-24d0e9f9-a5d0-4a06-85d5-5d1ca7469897 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:04:36.604875 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-24d0e9f9-a5d0-4a06-85d5-5d1ca7469897 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:36.608973 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-222871dc-0f53-4385-b815-01a3003e786d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:36.610300 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-222871dc-0f53-4385-b815-01a3003e786d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:36.612702 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-24d0e9f9-a5d0-4a06-85d5-5d1ca7469897 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:36.613294 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-24d0e9f9-a5d0-4a06-85d5-5d1ca7469897 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:36.614185 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-24d0e9f9-a5d0-4a06-85d5-5d1ca7469897 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:36.614970 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-24d0e9f9-a5d0-4a06-85d5-5d1ca7469897 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:36.620201 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-222871dc-0f53-4385-b815-01a3003e786d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:36.621264 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-222871dc-0f53-4385-b815-01a3003e786d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:36.623001 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-222871dc-0f53-4385-b815-01a3003e786d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:36.623761 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-222871dc-0f53-4385-b815-01a3003e786d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:36.709716 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.objects.instance [None req-24d0e9f9-a5d0-4a06-85d5-5d1ca7469897 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lazy-loading 'flavor' on Instance uuid 78398054-0c37-4dfb-8926-a199cdf30248 {{(pid=116084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:04:36.830948 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-222871dc-0f53-4385-b815-01a3003e786d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:36.839741 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-222871dc-0f53-4385-b815-01a3003e786d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:36.840822 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-222871dc-0f53-4385-b815-01a3003e786d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:36.853329 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-222871dc-0f53-4385-b815-01a3003e786d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1407 microversion: 2.20 time: 0.247861 Nov 16 16:04:36.853916 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 55/119] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:04:36 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1407 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:04:36.885510 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-24d0e9f9-a5d0-4a06-85d5-5d1ca7469897 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "POST /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248/action" status: 200 len: 32 microversion: 2.1 time: 0.284986 Nov 16 16:04:36.886304 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 65/120] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:04:36 2021] POST /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248/action => generated 32 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 16:04:36.896346 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-c0a7ccbf-166a-4c82-a5bf-4b32bce952e1 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:36.897196 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-c0a7ccbf-166a-4c82-a5bf-4b32bce952e1 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:36.912668 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c0a7ccbf-166a-4c82-a5bf-4b32bce952e1 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:36.913297 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c0a7ccbf-166a-4c82-a5bf-4b32bce952e1 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:36.915190 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c0a7ccbf-166a-4c82-a5bf-4b32bce952e1 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:36.916766 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c0a7ccbf-166a-4c82-a5bf-4b32bce952e1 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:37.270301 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-c0a7ccbf-166a-4c82-a5bf-4b32bce952e1 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:37.278806 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-c0a7ccbf-166a-4c82-a5bf-4b32bce952e1 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248" status: 200 len: 1522 microversion: 2.1 time: 0.387105 Nov 16 16:04:37.282956 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 56/121] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:36 2021] GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248 => generated 1522 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:37.440956 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-79a606b6-d935-4cd8-ad5e-fcea06ee226c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:37.442594 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-79a606b6-d935-4cd8-ad5e-fcea06ee226c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:37.459818 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-79a606b6-d935-4cd8-ad5e-fcea06ee226c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:37.460627 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-79a606b6-d935-4cd8-ad5e-fcea06ee226c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:37.462615 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-79a606b6-d935-4cd8-ad5e-fcea06ee226c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:37.463059 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-79a606b6-d935-4cd8-ad5e-fcea06ee226c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:37.585129 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-967b9a83-ae09-487e-94ea-d75a6424428f tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:37.585904 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-967b9a83-ae09-487e-94ea-d75a6424428f tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] [instance: fe8f46c2-6a46-484f-8b50-29407c7207c7] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:37.593238 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-967b9a83-ae09-487e-94ea-d75a6424428f tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:37.594597 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-967b9a83-ae09-487e-94ea-d75a6424428f tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:37.596025 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-967b9a83-ae09-487e-94ea-d75a6424428f tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:37.596458 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-967b9a83-ae09-487e-94ea-d75a6424428f tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:37.711795 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-967b9a83-ae09-487e-94ea-d75a6424428f tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baeb57cceead4eda9ec354d996c7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52edf438b5b545dfaa8dcdba31441017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:37.733698 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-967b9a83-ae09-487e-94ea-d75a6424428f tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] 10.222.0.46 "GET /compute/v2.1/servers/fe8f46c2-6a46-484f-8b50-29407c7207c7" status: 200 len: 1272 microversion: 2.1 time: 0.153144 Nov 16 16:04:37.734483 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 57/122] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:37 2021] GET /compute/v2.1/servers/fe8f46c2-6a46-484f-8b50-29407c7207c7 => generated 1272 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:37.850845 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-79a606b6-d935-4cd8-ad5e-fcea06ee226c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:37.860907 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-79a606b6-d935-4cd8-ad5e-fcea06ee226c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1361 microversion: 2.1 time: 0.424762 Nov 16 16:04:37.862060 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 66/123] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:37 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1361 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:37.874439 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-657324f4-bbdd-4db6-b43c-8c20af44e19d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:37.876269 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-657324f4-bbdd-4db6-b43c-8c20af44e19d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:37.883103 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-657324f4-bbdd-4db6-b43c-8c20af44e19d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:37.883618 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-657324f4-bbdd-4db6-b43c-8c20af44e19d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:37.884748 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-657324f4-bbdd-4db6-b43c-8c20af44e19d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:37.885182 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-657324f4-bbdd-4db6-b43c-8c20af44e19d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:38.123921 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-657324f4-bbdd-4db6-b43c-8c20af44e19d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:38.132619 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-657324f4-bbdd-4db6-b43c-8c20af44e19d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:38.134706 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-657324f4-bbdd-4db6-b43c-8c20af44e19d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:38.135876 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-657324f4-bbdd-4db6-b43c-8c20af44e19d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1407 microversion: 2.20 time: 0.266595 Nov 16 16:04:38.136437 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 58/124] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:04:37 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1407 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:04:38.299278 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-555b3192-434d-43ed-98a1-5ee5c2913f37 req-6c51c1ee-e986-4767-a382-977a1c82fc0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6447972e-6291-4e68-8271-c93523206230", "name": "network-vif-plugged", "status": "completed", "tag": "68ede3d7-0ef4-42a4-b3de-ef6046161db6"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:04:38.300197 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-54f6c3a5-a3f8-4902-a6d3-b2a63c3b3e4e tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:38.301333 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-54f6c3a5-a3f8-4902-a6d3-b2a63c3b3e4e tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:38.301885 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:04:38.301885 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Nov 16 16:04:38.329064 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-54f6c3a5-a3f8-4902-a6d3-b2a63c3b3e4e tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:38.329577 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-54f6c3a5-a3f8-4902-a6d3-b2a63c3b3e4e tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:38.330399 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-54f6c3a5-a3f8-4902-a6d3-b2a63c3b3e4e tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:38.331444 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-555b3192-434d-43ed-98a1-5ee5c2913f37 req-6c51c1ee-e986-4767-a382-977a1c82fc0f service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:38.332072 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-555b3192-434d-43ed-98a1-5ee5c2913f37 req-6c51c1ee-e986-4767-a382-977a1c82fc0f service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:38.335403 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-54f6c3a5-a3f8-4902-a6d3-b2a63c3b3e4e tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:38.360385 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-555b3192-434d-43ed-98a1-5ee5c2913f37 req-6c51c1ee-e986-4767-a382-977a1c82fc0f service nova] Creating event network-vif-plugged:68ede3d7-0ef4-42a4-b3de-ef6046161db6 for instance 6447972e-6291-4e68-8271-c93523206230 on hv-cinder-81809 Nov 16 16:04:38.366233 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-555b3192-434d-43ed-98a1-5ee5c2913f37 req-6c51c1ee-e986-4767-a382-977a1c82fc0f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071346 Nov 16 16:04:38.367002 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 67/125] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:04:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:04:38.753764 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-176e6b6b-5c79-4839-9fec-224e8765abbb tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:38.754525 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-176e6b6b-5c79-4839-9fec-224e8765abbb tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] [instance: fe8f46c2-6a46-484f-8b50-29407c7207c7] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:38.757920 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-54f6c3a5-a3f8-4902-a6d3-b2a63c3b3e4e tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:38.768493 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-54f6c3a5-a3f8-4902-a6d3-b2a63c3b3e4e tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248" status: 200 len: 1522 microversion: 2.1 time: 0.472133 Nov 16 16:04:38.770189 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-176e6b6b-5c79-4839-9fec-224e8765abbb tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:38.770634 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-176e6b6b-5c79-4839-9fec-224e8765abbb tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:38.771421 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-176e6b6b-5c79-4839-9fec-224e8765abbb tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:38.773230 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 59/126] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:38 2021] GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248 => generated 1522 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:38.781335 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-176e6b6b-5c79-4839-9fec-224e8765abbb tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:38.879605 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-285c97e7-2e8e-401a-8e7c-77bd759dca40 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:38.880599 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-285c97e7-2e8e-401a-8e7c-77bd759dca40 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:38.892170 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-285c97e7-2e8e-401a-8e7c-77bd759dca40 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:38.892629 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-285c97e7-2e8e-401a-8e7c-77bd759dca40 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:38.896469 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-285c97e7-2e8e-401a-8e7c-77bd759dca40 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:38.898643 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-285c97e7-2e8e-401a-8e7c-77bd759dca40 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:39.224371 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-176e6b6b-5c79-4839-9fec-224e8765abbb tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baeb57cceead4eda9ec354d996c7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52edf438b5b545dfaa8dcdba31441017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:39.240898 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-176e6b6b-5c79-4839-9fec-224e8765abbb tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] 10.222.0.46 "GET /compute/v2.1/servers/fe8f46c2-6a46-484f-8b50-29407c7207c7" status: 200 len: 1314 microversion: 2.1 time: 0.493143 Nov 16 16:04:39.253171 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 68/127] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:38 2021] GET /compute/v2.1/servers/fe8f46c2-6a46-484f-8b50-29407c7207c7 => generated 1314 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:39.262518 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6bb82fbc-c012-49be-a856-79d7a3b12ee5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:39.264301 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-6bb82fbc-c012-49be-a856-79d7a3b12ee5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:39.287496 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6bb82fbc-c012-49be-a856-79d7a3b12ee5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:39.291968 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6bb82fbc-c012-49be-a856-79d7a3b12ee5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:39.293522 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6bb82fbc-c012-49be-a856-79d7a3b12ee5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:39.294358 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6bb82fbc-c012-49be-a856-79d7a3b12ee5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:39.321160 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-285c97e7-2e8e-401a-8e7c-77bd759dca40 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:39.333843 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-285c97e7-2e8e-401a-8e7c-77bd759dca40 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1361 microversion: 2.1 time: 0.454270 Nov 16 16:04:39.340107 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 60/128] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:38 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1361 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:39.404098 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-5444a317-bed2-42d3-a8d3-4c2f952e12b3 req-d217eba0-0d19-44e0-a3d2-f461571ea2fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe8f46c2-6a46-484f-8b50-29407c7207c7", "tag": "30f5ecc5-351c-4279-9dc1-cc7b6e72b52e"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:04:39.406491 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:04:39.406491 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Nov 16 16:04:39.426757 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-5444a317-bed2-42d3-a8d3-4c2f952e12b3 req-d217eba0-0d19-44e0-a3d2-f461571ea2fb service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:39.427275 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-5444a317-bed2-42d3-a8d3-4c2f952e12b3 req-d217eba0-0d19-44e0-a3d2-f461571ea2fb service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:39.459669 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-5444a317-bed2-42d3-a8d3-4c2f952e12b3 req-d217eba0-0d19-44e0-a3d2-f461571ea2fb service nova] Creating event network-changed:30f5ecc5-351c-4279-9dc1-cc7b6e72b52e for instance fe8f46c2-6a46-484f-8b50-29407c7207c7 on hv-cinder-81809 Nov 16 16:04:39.473618 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-5444a317-bed2-42d3-a8d3-4c2f952e12b3 req-d217eba0-0d19-44e0-a3d2-f461571ea2fb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072651 Nov 16 16:04:39.474658 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 61/129] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:04:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:04:39.549087 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-6bb82fbc-c012-49be-a856-79d7a3b12ee5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:39.560508 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-6bb82fbc-c012-49be-a856-79d7a3b12ee5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:39.566543 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-6bb82fbc-c012-49be-a856-79d7a3b12ee5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:39.567911 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-6bb82fbc-c012-49be-a856-79d7a3b12ee5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1407 microversion: 2.20 time: 0.312523 Nov 16 16:04:39.569542 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 69/130] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:04:39 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1407 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:04:39.788393 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-d0da5f09-6ac0-4dcf-94d1-02bd6a02faff tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:39.789097 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-d0da5f09-6ac0-4dcf-94d1-02bd6a02faff tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:39.800656 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d0da5f09-6ac0-4dcf-94d1-02bd6a02faff tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:39.801110 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d0da5f09-6ac0-4dcf-94d1-02bd6a02faff tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:39.801902 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d0da5f09-6ac0-4dcf-94d1-02bd6a02faff tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:39.804180 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d0da5f09-6ac0-4dcf-94d1-02bd6a02faff tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:40.090669 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-d0da5f09-6ac0-4dcf-94d1-02bd6a02faff tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:40.102735 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-d0da5f09-6ac0-4dcf-94d1-02bd6a02faff tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248" status: 200 len: 1522 microversion: 2.1 time: 0.318361 Nov 16 16:04:40.107704 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 62/131] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:39 2021] GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248 => generated 1522 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:40.259996 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b2066c12-09c9-4c28-aaec-6ced9ffa49ae tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:40.261886 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b2066c12-09c9-4c28-aaec-6ced9ffa49ae tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] [instance: fe8f46c2-6a46-484f-8b50-29407c7207c7] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:40.276402 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b2066c12-09c9-4c28-aaec-6ced9ffa49ae tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:40.277044 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b2066c12-09c9-4c28-aaec-6ced9ffa49ae tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:40.278275 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b2066c12-09c9-4c28-aaec-6ced9ffa49ae tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:40.279778 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b2066c12-09c9-4c28-aaec-6ced9ffa49ae tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:40.350018 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-dd942de6-2bb0-497d-ad8e-cb61409bcad0 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:40.350770 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-dd942de6-2bb0-497d-ad8e-cb61409bcad0 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:40.359565 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-dd942de6-2bb0-497d-ad8e-cb61409bcad0 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:40.361320 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-dd942de6-2bb0-497d-ad8e-cb61409bcad0 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:40.363203 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-dd942de6-2bb0-497d-ad8e-cb61409bcad0 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:40.364731 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-dd942de6-2bb0-497d-ad8e-cb61409bcad0 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:40.610639 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b2066c12-09c9-4c28-aaec-6ced9ffa49ae tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baeb57cceead4eda9ec354d996c7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52edf438b5b545dfaa8dcdba31441017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:40.619533 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b2066c12-09c9-4c28-aaec-6ced9ffa49ae tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] 10.222.0.46 "GET /compute/v2.1/servers/fe8f46c2-6a46-484f-8b50-29407c7207c7" status: 200 len: 1314 microversion: 2.1 time: 0.363651 Nov 16 16:04:40.631694 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 70/132] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:40 2021] GET /compute/v2.1/servers/fe8f46c2-6a46-484f-8b50-29407c7207c7 => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:40.638736 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-dd942de6-2bb0-497d-ad8e-cb61409bcad0 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:40.642583 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-c492d476-ac37-468f-a113-c4ce4d37ac4c req-875a7721-2a07-4090-823d-e355b706376b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "674c9e04-e56c-4891-adc1-7cdac0c8510f", "name": "network-vif-plugged", "status": "completed", "tag": "07aae0fa-265c-47a8-af4f-ea385dbee127"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:04:40.645387 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:04:40.645387 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Nov 16 16:04:40.660055 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-c492d476-ac37-468f-a113-c4ce4d37ac4c req-875a7721-2a07-4090-823d-e355b706376b service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:40.660652 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-c492d476-ac37-468f-a113-c4ce4d37ac4c req-875a7721-2a07-4090-823d-e355b706376b service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:40.666777 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-dd942de6-2bb0-497d-ad8e-cb61409bcad0 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1361 microversion: 2.1 time: 0.319486 Nov 16 16:04:40.668870 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 63/133] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:40 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1361 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:40.690521 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-c492d476-ac37-468f-a113-c4ce4d37ac4c req-875a7721-2a07-4090-823d-e355b706376b service nova] Creating event network-vif-plugged:07aae0fa-265c-47a8-af4f-ea385dbee127 for instance 674c9e04-e56c-4891-adc1-7cdac0c8510f on hv-cinder-81809 Nov 16 16:04:40.693366 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-3f80dfa0-7703-4e0e-92de-c12fe29ef0d1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:40.694010 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-3f80dfa0-7703-4e0e-92de-c12fe29ef0d1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:40.698611 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-c492d476-ac37-468f-a113-c4ce4d37ac4c req-875a7721-2a07-4090-823d-e355b706376b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065313 Nov 16 16:04:40.700568 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 71/134] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:04:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:04:40.704947 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3f80dfa0-7703-4e0e-92de-c12fe29ef0d1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:40.706654 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3f80dfa0-7703-4e0e-92de-c12fe29ef0d1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:40.707842 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3f80dfa0-7703-4e0e-92de-c12fe29ef0d1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:40.708431 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3f80dfa0-7703-4e0e-92de-c12fe29ef0d1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:40.987590 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-3f80dfa0-7703-4e0e-92de-c12fe29ef0d1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:40.997265 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-3f80dfa0-7703-4e0e-92de-c12fe29ef0d1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:40.999196 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-3f80dfa0-7703-4e0e-92de-c12fe29ef0d1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:41.001283 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-3f80dfa0-7703-4e0e-92de-c12fe29ef0d1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1598 microversion: 2.20 time: 0.331413 Nov 16 16:04:41.002519 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 64/135] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:04:40 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1598 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:04:41.032615 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-69ddd680-c554-43ab-92f3-2c292feee735 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:41.034751 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-69ddd680-c554-43ab-92f3-2c292feee735 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:41.044852 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-69ddd680-c554-43ab-92f3-2c292feee735 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:41.046988 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-69ddd680-c554-43ab-92f3-2c292feee735 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:41.048586 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-69ddd680-c554-43ab-92f3-2c292feee735 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:41.050005 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-69ddd680-c554-43ab-92f3-2c292feee735 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:41.126515 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-4097d054-c4d2-4908-aa15-963c1c06e340 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:41.127606 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-4097d054-c4d2-4908-aa15-963c1c06e340 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:41.136741 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4097d054-c4d2-4908-aa15-963c1c06e340 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:41.137205 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4097d054-c4d2-4908-aa15-963c1c06e340 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:41.140721 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4097d054-c4d2-4908-aa15-963c1c06e340 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:41.141285 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4097d054-c4d2-4908-aa15-963c1c06e340 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:41.188264 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-69ddd680-c554-43ab-92f3-2c292feee735 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.166691 Nov 16 16:04:41.189273 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 72/136] 10.222.0.46 () {60 vars in 1315 bytes} [Tue Nov 16 16:04:41 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/os-interface => generated 284 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:04:41.645879 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-fe2180b8-8f33-4273-9187-d8d3d7c31bf7 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:41.647259 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-fe2180b8-8f33-4273-9187-d8d3d7c31bf7 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] [instance: fe8f46c2-6a46-484f-8b50-29407c7207c7] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:41.654892 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fe2180b8-8f33-4273-9187-d8d3d7c31bf7 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:41.655678 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fe2180b8-8f33-4273-9187-d8d3d7c31bf7 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:41.656830 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fe2180b8-8f33-4273-9187-d8d3d7c31bf7 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:41.657435 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fe2180b8-8f33-4273-9187-d8d3d7c31bf7 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:41.858107 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-4097d054-c4d2-4908-aa15-963c1c06e340 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:41.868397 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-4097d054-c4d2-4908-aa15-963c1c06e340 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248" status: 200 len: 1522 microversion: 2.1 time: 0.746827 Nov 16 16:04:41.870117 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 65/137] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:41 2021] GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248 => generated 1522 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:41.880909 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-ca635952-0420-405c-a6b5-bc1c7958c69e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:41.882074 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-ca635952-0420-405c-a6b5-bc1c7958c69e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:41.898089 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ca635952-0420-405c-a6b5-bc1c7958c69e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:41.898795 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ca635952-0420-405c-a6b5-bc1c7958c69e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:41.899932 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ca635952-0420-405c-a6b5-bc1c7958c69e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:41.900522 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ca635952-0420-405c-a6b5-bc1c7958c69e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:42.208465 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-fe2180b8-8f33-4273-9187-d8d3d7c31bf7 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baeb57cceead4eda9ec354d996c7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52edf438b5b545dfaa8dcdba31441017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:42.220355 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-fe2180b8-8f33-4273-9187-d8d3d7c31bf7 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] 10.222.0.46 "GET /compute/v2.1/servers/fe8f46c2-6a46-484f-8b50-29407c7207c7" status: 200 len: 1314 microversion: 2.1 time: 0.585050 Nov 16 16:04:42.223833 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 73/138] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:41 2021] GET /compute/v2.1/servers/fe8f46c2-6a46-484f-8b50-29407c7207c7 => generated 1314 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:42.422499 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-ca635952-0420-405c-a6b5-bc1c7958c69e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:42.433237 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-ca635952-0420-405c-a6b5-bc1c7958c69e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1361 microversion: 2.1 time: 0.561677 Nov 16 16:04:42.443068 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 66/139] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:41 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1361 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:42.887986 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-bf8e0dc3-9fcf-40f2-9827-c429920328f8 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:42.891162 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-bf8e0dc3-9fcf-40f2-9827-c429920328f8 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:42.903061 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bf8e0dc3-9fcf-40f2-9827-c429920328f8 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:42.904040 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bf8e0dc3-9fcf-40f2-9827-c429920328f8 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:42.908092 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bf8e0dc3-9fcf-40f2-9827-c429920328f8 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:42.908770 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bf8e0dc3-9fcf-40f2-9827-c429920328f8 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:43.087141 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-b429af60-b3cc-466b-af71-085bc347dc20 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:04:43.088304 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-b429af60-b3cc-466b-af71-085bc347dc20 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:43.098823 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b429af60-b3cc-466b-af71-085bc347dc20 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:43.104025 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b429af60-b3cc-466b-af71-085bc347dc20 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:43.104878 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b429af60-b3cc-466b-af71-085bc347dc20 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:43.105327 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b429af60-b3cc-466b-af71-085bc347dc20 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:43.186527 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-bf8e0dc3-9fcf-40f2-9827-c429920328f8 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:43.195264 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-bf8e0dc3-9fcf-40f2-9827-c429920328f8 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248" status: 200 len: 1522 microversion: 2.1 time: 0.311901 Nov 16 16:04:43.207514 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 74/140] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:42 2021] GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248 => generated 1522 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:43.210368 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-b429af60-b3cc-466b-af71-085bc347dc20 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action" status: 200 len: 14 microversion: 2.20 time: 0.126592 Nov 16 16:04:43.211379 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 67/141] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:04:43 2021] POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:43.212635 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-90c2e61d-bf4b-4184-8b59-296e17223a5c req-081d4b6c-9faa-4fb5-ac28-dc6694c6fd03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6447972e-6291-4e68-8271-c93523206230", "tag": "68ede3d7-0ef4-42a4-b3de-ef6046161db6"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:04:43.217570 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:04:43.217570 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Nov 16 16:04:43.228203 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-90c2e61d-bf4b-4184-8b59-296e17223a5c req-081d4b6c-9faa-4fb5-ac28-dc6694c6fd03 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:43.228735 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-90c2e61d-bf4b-4184-8b59-296e17223a5c req-081d4b6c-9faa-4fb5-ac28-dc6694c6fd03 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:43.242109 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-4bcfe209-3aae-4443-a5d9-c9df7396b631 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:43.242720 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-90c2e61d-bf4b-4184-8b59-296e17223a5c req-081d4b6c-9faa-4fb5-ac28-dc6694c6fd03 service nova] Creating event network-changed:68ede3d7-0ef4-42a4-b3de-ef6046161db6 for instance 6447972e-6291-4e68-8271-c93523206230 on hv-cinder-81809 Nov 16 16:04:43.243163 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-4bcfe209-3aae-4443-a5d9-c9df7396b631 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] [instance: fe8f46c2-6a46-484f-8b50-29407c7207c7] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:43.251663 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-90c2e61d-bf4b-4184-8b59-296e17223a5c req-081d4b6c-9faa-4fb5-ac28-dc6694c6fd03 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038966 Nov 16 16:04:43.252688 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 75/142] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:04:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:04:43.255305 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4bcfe209-3aae-4443-a5d9-c9df7396b631 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:43.255893 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4bcfe209-3aae-4443-a5d9-c9df7396b631 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:43.256550 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4bcfe209-3aae-4443-a5d9-c9df7396b631 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:43.257326 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4bcfe209-3aae-4443-a5d9-c9df7396b631 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:43.452212 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7ad6ced6-f670-49ea-a173-37f401deaae6 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:43.453900 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-7ad6ced6-f670-49ea-a173-37f401deaae6 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:43.462885 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7ad6ced6-f670-49ea-a173-37f401deaae6 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:43.463609 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7ad6ced6-f670-49ea-a173-37f401deaae6 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:43.464753 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7ad6ced6-f670-49ea-a173-37f401deaae6 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:43.465339 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7ad6ced6-f670-49ea-a173-37f401deaae6 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:43.522570 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-4bcfe209-3aae-4443-a5d9-c9df7396b631 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baeb57cceead4eda9ec354d996c7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52edf438b5b545dfaa8dcdba31441017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:43.533380 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-4bcfe209-3aae-4443-a5d9-c9df7396b631 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] 10.222.0.46 "GET /compute/v2.1/servers/fe8f46c2-6a46-484f-8b50-29407c7207c7" status: 200 len: 1314 microversion: 2.1 time: 0.297016 Nov 16 16:04:43.543138 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 68/143] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:43 2021] GET /compute/v2.1/servers/fe8f46c2-6a46-484f-8b50-29407c7207c7 => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:04:43.696434 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7ad6ced6-f670-49ea-a173-37f401deaae6 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:43.707499 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-7ad6ced6-f670-49ea-a173-37f401deaae6 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1546 microversion: 2.1 time: 0.260296 Nov 16 16:04:43.719881 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 76/144] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:43 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1546 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:43.725567 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-bbde71ed-1120-46fb-a3ba-abe5a858d465 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:43.726077 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-bbde71ed-1120-46fb-a3ba-abe5a858d465 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:43.737403 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bbde71ed-1120-46fb-a3ba-abe5a858d465 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:43.737893 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bbde71ed-1120-46fb-a3ba-abe5a858d465 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:43.738661 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bbde71ed-1120-46fb-a3ba-abe5a858d465 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:43.739184 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bbde71ed-1120-46fb-a3ba-abe5a858d465 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:43.845581 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-bbde71ed-1120-46fb-a3ba-abe5a858d465 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.124278 Nov 16 16:04:43.846540 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 69/145] 10.222.0.46 () {58 vars in 1274 bytes} [Tue Nov 16 16:04:43 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/os-interface => generated 285 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:04:44.213969 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-29fb32d8-c8eb-48ee-b6ab-e35cd5c4483d tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:44.215227 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-29fb32d8-c8eb-48ee-b6ab-e35cd5c4483d tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:44.222902 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-6c58f925-f196-4f1f-a2dc-5ade4d6fb0ff tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:04:44.223929 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-6c58f925-f196-4f1f-a2dc-5ade4d6fb0ff tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:44.236914 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-29fb32d8-c8eb-48ee-b6ab-e35cd5c4483d tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:44.241055 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6c58f925-f196-4f1f-a2dc-5ade4d6fb0ff tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:44.241514 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6c58f925-f196-4f1f-a2dc-5ade4d6fb0ff tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:44.242319 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6c58f925-f196-4f1f-a2dc-5ade4d6fb0ff tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:44.242821 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6c58f925-f196-4f1f-a2dc-5ade4d6fb0ff tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:44.244114 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-29fb32d8-c8eb-48ee-b6ab-e35cd5c4483d tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:44.245001 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-29fb32d8-c8eb-48ee-b6ab-e35cd5c4483d tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:44.245437 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-29fb32d8-c8eb-48ee-b6ab-e35cd5c4483d tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:44.417684 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-6c58f925-f196-4f1f-a2dc-5ade4d6fb0ff tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action" status: 200 len: 14 microversion: 2.20 time: 0.199706 Nov 16 16:04:44.418325 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 70/146] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:04:44 2021] POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action => generated 14 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:04:44.430619 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-16195343-6e47-41e7-9a43-e730a4144416 req-3ce19984-c29a-4cf8-8623-0f675f39d6a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe8f46c2-6a46-484f-8b50-29407c7207c7", "name": "network-vif-plugged", "status": "completed", "tag": "30f5ecc5-351c-4279-9dc1-cc7b6e72b52e"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:04:44.432326 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:04:44.432326 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Nov 16 16:04:44.457594 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-16195343-6e47-41e7-9a43-e730a4144416 req-3ce19984-c29a-4cf8-8623-0f675f39d6a4 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:44.458126 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-16195343-6e47-41e7-9a43-e730a4144416 req-3ce19984-c29a-4cf8-8623-0f675f39d6a4 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:44.523075 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-16195343-6e47-41e7-9a43-e730a4144416 req-3ce19984-c29a-4cf8-8623-0f675f39d6a4 service nova] Creating event network-vif-plugged:30f5ecc5-351c-4279-9dc1-cc7b6e72b52e for instance fe8f46c2-6a46-484f-8b50-29407c7207c7 on hv-cinder-81809 Nov 16 16:04:44.545118 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-16195343-6e47-41e7-9a43-e730a4144416 req-3ce19984-c29a-4cf8-8623-0f675f39d6a4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119575 Nov 16 16:04:44.550668 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 71/147] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:04:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:04:44.584331 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-2ff53e64-5faa-4a16-b50d-a25e15b54cb9 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:44.588408 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-2ff53e64-5faa-4a16-b50d-a25e15b54cb9 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] [instance: fe8f46c2-6a46-484f-8b50-29407c7207c7] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:44.604451 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2ff53e64-5faa-4a16-b50d-a25e15b54cb9 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:44.605181 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2ff53e64-5faa-4a16-b50d-a25e15b54cb9 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:44.606380 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2ff53e64-5faa-4a16-b50d-a25e15b54cb9 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:44.607001 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2ff53e64-5faa-4a16-b50d-a25e15b54cb9 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:44.650346 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-29fb32d8-c8eb-48ee-b6ab-e35cd5c4483d tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:44.662416 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-29fb32d8-c8eb-48ee-b6ab-e35cd5c4483d tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248" status: 200 len: 1522 microversion: 2.1 time: 0.452187 Nov 16 16:04:44.663638 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 77/148] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:44 2021] GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248 => generated 1522 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:44.864568 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-2ff53e64-5faa-4a16-b50d-a25e15b54cb9 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baeb57cceead4eda9ec354d996c7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52edf438b5b545dfaa8dcdba31441017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:44.872567 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-2ff53e64-5faa-4a16-b50d-a25e15b54cb9 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] 10.222.0.46 "GET /compute/v2.1/servers/fe8f46c2-6a46-484f-8b50-29407c7207c7" status: 200 len: 1314 microversion: 2.1 time: 0.320224 Nov 16 16:04:44.873469 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 72/149] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:44 2021] GET /compute/v2.1/servers/fe8f46c2-6a46-484f-8b50-29407c7207c7 => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:45.265896 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-fe936cc8-a061-4491-a335-a2832dc7c152 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:45.266481 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-fe936cc8-a061-4491-a335-a2832dc7c152 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] [instance: d8c53b20-4a71-421c-b123-bd5f6ccc6fe0] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:45.272970 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fe936cc8-a061-4491-a335-a2832dc7c152 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:45.273414 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fe936cc8-a061-4491-a335-a2832dc7c152 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:45.274216 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fe936cc8-a061-4491-a335-a2832dc7c152 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:45.274642 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fe936cc8-a061-4491-a335-a2832dc7c152 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:45.300000 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-fe936cc8-a061-4491-a335-a2832dc7c152 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] [instance: d8c53b20-4a71-421c-b123-bd5f6ccc6fe0] Going to try to terminate instance {{(pid=116084) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 16:04:45.397666 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-fe936cc8-a061-4491-a335-a2832dc7c152 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0" status: 204 len: 0 microversion: 2.1 time: 0.136264 Nov 16 16:04:45.401303 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 78/150] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 16 16:04:45 2021] DELETE /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 16:04:45.406911 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-a650dc42-b408-41a1-b22f-88bdf3321a87 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:45.407529 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-a650dc42-b408-41a1-b22f-88bdf3321a87 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] [instance: d8c53b20-4a71-421c-b123-bd5f6ccc6fe0] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:45.413912 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a650dc42-b408-41a1-b22f-88bdf3321a87 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:45.414353 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a650dc42-b408-41a1-b22f-88bdf3321a87 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:45.415119 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a650dc42-b408-41a1-b22f-88bdf3321a87 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:45.415804 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a650dc42-b408-41a1-b22f-88bdf3321a87 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:45.429877 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-2a2e7d67-26e8-4752-bc2f-73537d9962ec tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:04:45.430885 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-2a2e7d67-26e8-4752-bc2f-73537d9962ec tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:45.438668 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2a2e7d67-26e8-4752-bc2f-73537d9962ec tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:45.439121 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2a2e7d67-26e8-4752-bc2f-73537d9962ec tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:45.440113 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2a2e7d67-26e8-4752-bc2f-73537d9962ec tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:45.440483 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2a2e7d67-26e8-4752-bc2f-73537d9962ec tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:45.571171 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-a650dc42-b408-41a1-b22f-88bdf3321a87 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697a7c6cbf144a6d9d8594b9c8553c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565c2a8ebcd14908b53a63401ebcb81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:45.571756 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-2a2e7d67-26e8-4752-bc2f-73537d9962ec tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action" status: 200 len: 14 microversion: 2.20 time: 0.145892 Nov 16 16:04:45.572749 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 79/151] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:04:45 2021] POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:45.581972 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-a650dc42-b408-41a1-b22f-88bdf3321a87 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] 10.222.0.46 "GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0" status: 200 len: 1554 microversion: 2.1 time: 0.179144 Nov 16 16:04:45.582545 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 73/152] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:45 2021] GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0 => generated 1554 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:45.680585 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1111a0f4-bf7a-4a30-ab6f-e413ed3cf814 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:45.682141 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1111a0f4-bf7a-4a30-ab6f-e413ed3cf814 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:45.691153 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1111a0f4-bf7a-4a30-ab6f-e413ed3cf814 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:45.692507 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1111a0f4-bf7a-4a30-ab6f-e413ed3cf814 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:45.693473 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1111a0f4-bf7a-4a30-ab6f-e413ed3cf814 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:45.694490 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1111a0f4-bf7a-4a30-ab6f-e413ed3cf814 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:45.890951 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-017f6eb0-27ed-4f84-9bb7-f3da7c926655 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:45.891996 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-017f6eb0-27ed-4f84-9bb7-f3da7c926655 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] [instance: fe8f46c2-6a46-484f-8b50-29407c7207c7] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:45.903453 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-017f6eb0-27ed-4f84-9bb7-f3da7c926655 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:45.904044 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-017f6eb0-27ed-4f84-9bb7-f3da7c926655 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:45.904953 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-017f6eb0-27ed-4f84-9bb7-f3da7c926655 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:45.907220 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-017f6eb0-27ed-4f84-9bb7-f3da7c926655 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:45.909669 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1111a0f4-bf7a-4a30-ab6f-e413ed3cf814 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:45.920870 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1111a0f4-bf7a-4a30-ab6f-e413ed3cf814 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248" status: 200 len: 1522 microversion: 2.1 time: 0.244115 Nov 16 16:04:45.921779 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 80/153] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:45 2021] GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:45.963769 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-38fb52a5-1404-4204-a0e0-9bfb11b4b6a8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:04:45.965099 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-38fb52a5-1404-4204-a0e0-9bfb11b4b6a8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:45.974897 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-38fb52a5-1404-4204-a0e0-9bfb11b4b6a8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:45.975775 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-38fb52a5-1404-4204-a0e0-9bfb11b4b6a8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:45.978807 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-38fb52a5-1404-4204-a0e0-9bfb11b4b6a8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:45.979549 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-38fb52a5-1404-4204-a0e0-9bfb11b4b6a8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:46.083910 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-38fb52a5-1404-4204-a0e0-9bfb11b4b6a8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action" status: 200 len: 14 microversion: 2.1 time: 0.124057 Nov 16 16:04:46.084565 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-017f6eb0-27ed-4f84-9bb7-f3da7c926655 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baeb57cceead4eda9ec354d996c7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52edf438b5b545dfaa8dcdba31441017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:46.088284 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 81/154] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:04:45 2021] POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 16:04:46.093583 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-017f6eb0-27ed-4f84-9bb7-f3da7c926655 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] 10.222.0.46 "GET /compute/v2.1/servers/fe8f46c2-6a46-484f-8b50-29407c7207c7" status: 200 len: 1314 microversion: 2.1 time: 0.207129 Nov 16 16:04:46.095847 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-b79b2ae4-117f-4050-b840-c094f3125dc3 req-95a0121b-6521-4c3d-a2bb-89c338b88ad7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "674c9e04-e56c-4891-adc1-7cdac0c8510f", "tag": "07aae0fa-265c-47a8-af4f-ea385dbee127"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:04:46.098017 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:04:46.098017 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Nov 16 16:04:46.103656 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 74/155] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:45 2021] GET /compute/v2.1/servers/fe8f46c2-6a46-484f-8b50-29407c7207c7 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:46.106487 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-b79b2ae4-117f-4050-b840-c094f3125dc3 req-95a0121b-6521-4c3d-a2bb-89c338b88ad7 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:46.106926 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-b79b2ae4-117f-4050-b840-c094f3125dc3 req-95a0121b-6521-4c3d-a2bb-89c338b88ad7 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:46.119255 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-b79b2ae4-117f-4050-b840-c094f3125dc3 req-95a0121b-6521-4c3d-a2bb-89c338b88ad7 service nova] Creating event network-changed:07aae0fa-265c-47a8-af4f-ea385dbee127 for instance 674c9e04-e56c-4891-adc1-7cdac0c8510f on hv-cinder-81809 Nov 16 16:04:46.131035 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-b79b2ae4-117f-4050-b840-c094f3125dc3 req-95a0121b-6521-4c3d-a2bb-89c338b88ad7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040656 Nov 16 16:04:46.131675 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 82/156] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:04:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:04:46.584289 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-1f21d1cb-eba1-4ec8-bed1-46eb66507d2c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:04:46.585207 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-1f21d1cb-eba1-4ec8-bed1-46eb66507d2c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:46.596921 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1f21d1cb-eba1-4ec8-bed1-46eb66507d2c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:46.597601 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1f21d1cb-eba1-4ec8-bed1-46eb66507d2c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:46.598552 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1f21d1cb-eba1-4ec8-bed1-46eb66507d2c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:46.599139 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1f21d1cb-eba1-4ec8-bed1-46eb66507d2c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:46.601785 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-5f9e0092-77c4-43bc-9983-d9e14ef8b663 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:46.602664 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-5f9e0092-77c4-43bc-9983-d9e14ef8b663 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] [instance: d8c53b20-4a71-421c-b123-bd5f6ccc6fe0] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:46.610925 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5f9e0092-77c4-43bc-9983-d9e14ef8b663 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:46.611831 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5f9e0092-77c4-43bc-9983-d9e14ef8b663 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:46.612893 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5f9e0092-77c4-43bc-9983-d9e14ef8b663 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:46.613533 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5f9e0092-77c4-43bc-9983-d9e14ef8b663 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:46.716431 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-1f21d1cb-eba1-4ec8-bed1-46eb66507d2c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action" status: 200 len: 14 microversion: 2.20 time: 0.137112 Nov 16 16:04:46.719731 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 75/157] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:04:46 2021] POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action => generated 14 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:46.847937 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-5f9e0092-77c4-43bc-9983-d9e14ef8b663 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697a7c6cbf144a6d9d8594b9c8553c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565c2a8ebcd14908b53a63401ebcb81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:46.860206 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-5f9e0092-77c4-43bc-9983-d9e14ef8b663 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] 10.222.0.46 "GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0" status: 200 len: 1554 microversion: 2.1 time: 0.263552 Nov 16 16:04:46.862674 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 83/158] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:46 2021] GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0 => generated 1554 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:04:46.940607 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-46e836f8-5a45-46a8-a0fa-2ccc9d34d067 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:46.941211 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-46e836f8-5a45-46a8-a0fa-2ccc9d34d067 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:46.948486 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-46e836f8-5a45-46a8-a0fa-2ccc9d34d067 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:46.948925 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-46e836f8-5a45-46a8-a0fa-2ccc9d34d067 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:46.949693 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-46e836f8-5a45-46a8-a0fa-2ccc9d34d067 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:46.950846 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-46e836f8-5a45-46a8-a0fa-2ccc9d34d067 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:47.095015 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-9fcf4823-aa83-414c-8635-fc9cbd5983c0 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:04:47.096022 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-9fcf4823-aa83-414c-8635-fc9cbd5983c0 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:47.102363 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9fcf4823-aa83-414c-8635-fc9cbd5983c0 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:47.103103 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9fcf4823-aa83-414c-8635-fc9cbd5983c0 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:47.104103 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9fcf4823-aa83-414c-8635-fc9cbd5983c0 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:47.104689 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9fcf4823-aa83-414c-8635-fc9cbd5983c0 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:47.119601 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-46e836f8-5a45-46a8-a0fa-2ccc9d34d067 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:47.128529 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-46e836f8-5a45-46a8-a0fa-2ccc9d34d067 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248" status: 200 len: 1522 microversion: 2.1 time: 0.193875 Nov 16 16:04:47.139818 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 76/159] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:46 2021] GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:47.144488 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-9cf33247-9ef0-4c6a-95eb-4a5168c81aff tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:47.144984 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-9cf33247-9ef0-4c6a-95eb-4a5168c81aff tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] [instance: fe8f46c2-6a46-484f-8b50-29407c7207c7] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:47.151250 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9cf33247-9ef0-4c6a-95eb-4a5168c81aff tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:47.151734 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9cf33247-9ef0-4c6a-95eb-4a5168c81aff tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:47.152870 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9cf33247-9ef0-4c6a-95eb-4a5168c81aff tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:47.153193 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9cf33247-9ef0-4c6a-95eb-4a5168c81aff tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:47.206413 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-9fcf4823-aa83-414c-8635-fc9cbd5983c0 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action" status: 200 len: 14 microversion: 2.1 time: 0.114932 Nov 16 16:04:47.211121 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 84/160] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:04:47 2021] POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 16 16:04:47.370254 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-9cf33247-9ef0-4c6a-95eb-4a5168c81aff tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baeb57cceead4eda9ec354d996c7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52edf438b5b545dfaa8dcdba31441017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:47.381555 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-9cf33247-9ef0-4c6a-95eb-4a5168c81aff tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] 10.222.0.46 "GET /compute/v2.1/servers/fe8f46c2-6a46-484f-8b50-29407c7207c7" status: 200 len: 1464 microversion: 2.1 time: 0.238906 Nov 16 16:04:47.395542 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 77/161] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:47 2021] GET /compute/v2.1/servers/fe8f46c2-6a46-484f-8b50-29407c7207c7 => generated 1464 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:47.429361 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-117e0ec9-b228-4dda-8733-2b98c023f237 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:47.429996 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-117e0ec9-b228-4dda-8733-2b98c023f237 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] [instance: fe8f46c2-6a46-484f-8b50-29407c7207c7] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:47.437831 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-117e0ec9-b228-4dda-8733-2b98c023f237 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:47.438477 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-117e0ec9-b228-4dda-8733-2b98c023f237 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:47.439247 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-117e0ec9-b228-4dda-8733-2b98c023f237 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:47.439711 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-117e0ec9-b228-4dda-8733-2b98c023f237 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:47.468030 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-117e0ec9-b228-4dda-8733-2b98c023f237 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] [instance: fe8f46c2-6a46-484f-8b50-29407c7207c7] Going to try to terminate instance {{(pid=116084) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 16:04:47.576964 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-117e0ec9-b228-4dda-8733-2b98c023f237 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] 10.222.0.46 "DELETE /compute/v2.1/servers/fe8f46c2-6a46-484f-8b50-29407c7207c7" status: 204 len: 0 microversion: 2.1 time: 0.151607 Nov 16 16:04:47.578531 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 85/162] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 16 16:04:47 2021] DELETE /compute/v2.1/servers/fe8f46c2-6a46-484f-8b50-29407c7207c7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 16:04:47.586001 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-2f425fea-4c17-41da-b3ae-db333467a047 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:47.587185 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-2f425fea-4c17-41da-b3ae-db333467a047 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] [instance: fe8f46c2-6a46-484f-8b50-29407c7207c7] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:47.595023 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2f425fea-4c17-41da-b3ae-db333467a047 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:47.595858 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2f425fea-4c17-41da-b3ae-db333467a047 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:47.597077 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2f425fea-4c17-41da-b3ae-db333467a047 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:47.597751 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2f425fea-4c17-41da-b3ae-db333467a047 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:47.733191 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c163fb80-ec97-40eb-a493-1eaf24a21ac4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:04:47.735425 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c163fb80-ec97-40eb-a493-1eaf24a21ac4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:47.744006 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c163fb80-ec97-40eb-a493-1eaf24a21ac4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:47.744627 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c163fb80-ec97-40eb-a493-1eaf24a21ac4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:47.745523 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c163fb80-ec97-40eb-a493-1eaf24a21ac4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:47.746064 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c163fb80-ec97-40eb-a493-1eaf24a21ac4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:47.750600 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-2f425fea-4c17-41da-b3ae-db333467a047 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baeb57cceead4eda9ec354d996c7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52edf438b5b545dfaa8dcdba31441017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:47.758137 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-2f425fea-4c17-41da-b3ae-db333467a047 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] 10.222.0.46 "GET /compute/v2.1/servers/fe8f46c2-6a46-484f-8b50-29407c7207c7" status: 200 len: 1470 microversion: 2.1 time: 0.175568 Nov 16 16:04:47.758757 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 78/163] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:47 2021] GET /compute/v2.1/servers/fe8f46c2-6a46-484f-8b50-29407c7207c7 => generated 1470 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:47.833531 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c163fb80-ec97-40eb-a493-1eaf24a21ac4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action" status: 200 len: 14 microversion: 2.20 time: 0.109458 Nov 16 16:04:47.834479 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 86/164] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:04:47 2021] POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:04:47.929091 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-3457bfa6-9961-46b1-80fe-93e0b973a96d tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:47.929935 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-3457bfa6-9961-46b1-80fe-93e0b973a96d tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] [instance: d8c53b20-4a71-421c-b123-bd5f6ccc6fe0] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:47.935828 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3457bfa6-9961-46b1-80fe-93e0b973a96d tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:47.936555 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3457bfa6-9961-46b1-80fe-93e0b973a96d tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:47.937975 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3457bfa6-9961-46b1-80fe-93e0b973a96d tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:47.938480 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3457bfa6-9961-46b1-80fe-93e0b973a96d tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:48.108704 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-3457bfa6-9961-46b1-80fe-93e0b973a96d tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697a7c6cbf144a6d9d8594b9c8553c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565c2a8ebcd14908b53a63401ebcb81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:48.118474 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-3457bfa6-9961-46b1-80fe-93e0b973a96d tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] 10.222.0.46 "GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0" status: 200 len: 1554 microversion: 2.1 time: 0.193039 Nov 16 16:04:48.119175 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 79/165] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:47 2021] GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0 => generated 1554 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:48.148641 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6c6f8be6-d16c-4c91-ade8-24601c750611 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:48.149723 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-6c6f8be6-d16c-4c91-ade8-24601c750611 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:48.157974 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6c6f8be6-d16c-4c91-ade8-24601c750611 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:48.158553 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6c6f8be6-d16c-4c91-ade8-24601c750611 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:48.159642 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6c6f8be6-d16c-4c91-ade8-24601c750611 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:48.160148 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6c6f8be6-d16c-4c91-ade8-24601c750611 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:48.218371 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-731aab07-757f-4b75-872b-c6eebb95c38c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:04:48.219944 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-731aab07-757f-4b75-872b-c6eebb95c38c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:48.226657 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-731aab07-757f-4b75-872b-c6eebb95c38c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:48.227328 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-731aab07-757f-4b75-872b-c6eebb95c38c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:48.228493 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-731aab07-757f-4b75-872b-c6eebb95c38c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:48.229518 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-731aab07-757f-4b75-872b-c6eebb95c38c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:48.306260 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-731aab07-757f-4b75-872b-c6eebb95c38c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action" status: 200 len: 14 microversion: 2.1 time: 0.091349 Nov 16 16:04:48.306900 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 80/166] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:04:48 2021] POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 16 16:04:48.360515 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-6c6f8be6-d16c-4c91-ade8-24601c750611 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:48.368024 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-6c6f8be6-d16c-4c91-ade8-24601c750611 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248" status: 200 len: 1522 microversion: 2.1 time: 0.224677 Nov 16 16:04:48.368602 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 87/167] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:48 2021] GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:48.777253 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-cb052f88-b5e1-4bf8-8226-63380345f462 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:48.778210 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-cb052f88-b5e1-4bf8-8226-63380345f462 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] [instance: fe8f46c2-6a46-484f-8b50-29407c7207c7] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:48.786598 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cb052f88-b5e1-4bf8-8226-63380345f462 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:48.787360 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cb052f88-b5e1-4bf8-8226-63380345f462 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:48.788334 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cb052f88-b5e1-4bf8-8226-63380345f462 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:48.788984 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cb052f88-b5e1-4bf8-8226-63380345f462 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:48.845878 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-32dc3b8b-4418-4ba3-bc0b-d8dc862d89a2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:04:48.846468 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-32dc3b8b-4418-4ba3-bc0b-d8dc862d89a2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:48.853054 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-32dc3b8b-4418-4ba3-bc0b-d8dc862d89a2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:48.853796 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-32dc3b8b-4418-4ba3-bc0b-d8dc862d89a2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:48.854794 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-32dc3b8b-4418-4ba3-bc0b-d8dc862d89a2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:48.855284 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-32dc3b8b-4418-4ba3-bc0b-d8dc862d89a2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:48.946687 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-32dc3b8b-4418-4ba3-bc0b-d8dc862d89a2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action" status: 200 len: 14 microversion: 2.20 time: 0.105792 Nov 16 16:04:48.950454 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 88/168] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:04:48 2021] POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:04:49.012709 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-cb052f88-b5e1-4bf8-8226-63380345f462 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baeb57cceead4eda9ec354d996c7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52edf438b5b545dfaa8dcdba31441017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:49.020861 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-cb052f88-b5e1-4bf8-8226-63380345f462 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] 10.222.0.46 "GET /compute/v2.1/servers/fe8f46c2-6a46-484f-8b50-29407c7207c7" status: 200 len: 1470 microversion: 2.1 time: 0.247597 Nov 16 16:04:49.021663 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 81/169] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:48 2021] GET /compute/v2.1/servers/fe8f46c2-6a46-484f-8b50-29407c7207c7 => generated 1470 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:49.136485 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-9baa19fc-1bbe-4fd9-9b44-85f11490e7d8 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:49.137287 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-9baa19fc-1bbe-4fd9-9b44-85f11490e7d8 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] [instance: d8c53b20-4a71-421c-b123-bd5f6ccc6fe0] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:49.145303 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9baa19fc-1bbe-4fd9-9b44-85f11490e7d8 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:49.145750 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9baa19fc-1bbe-4fd9-9b44-85f11490e7d8 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:49.146552 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9baa19fc-1bbe-4fd9-9b44-85f11490e7d8 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:49.146972 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9baa19fc-1bbe-4fd9-9b44-85f11490e7d8 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:49.213911 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-46b561bc-2c00-4a67-95fa-b35dd22a96ef req-d19cc0a8-9b76-4f57-be0e-004f35d850aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8c53b20-4a71-421c-b123-bd5f6ccc6fe0", "name": "network-vif-deleted", "tag": "4ac187bb-10df-4230-9320-5556a334a54d"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:04:49.215802 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:04:49.215802 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Nov 16 16:04:49.222937 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-9baa19fc-1bbe-4fd9-9b44-85f11490e7d8 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697a7c6cbf144a6d9d8594b9c8553c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565c2a8ebcd14908b53a63401ebcb81c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:49.230647 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-46b561bc-2c00-4a67-95fa-b35dd22a96ef req-d19cc0a8-9b76-4f57-be0e-004f35d850aa service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:49.231325 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-46b561bc-2c00-4a67-95fa-b35dd22a96ef req-d19cc0a8-9b76-4f57-be0e-004f35d850aa service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:49.239924 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-9baa19fc-1bbe-4fd9-9b44-85f11490e7d8 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] 10.222.0.46 "GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0" status: 200 len: 1512 microversion: 2.1 time: 0.107302 Nov 16 16:04:49.242328 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 89/170] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:49 2021] GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0 => generated 1512 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:49.253058 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-46b561bc-2c00-4a67-95fa-b35dd22a96ef req-d19cc0a8-9b76-4f57-be0e-004f35d850aa service nova] Creating event network-vif-deleted:4ac187bb-10df-4230-9320-5556a334a54d for instance d8c53b20-4a71-421c-b123-bd5f6ccc6fe0 on hv-cinder-81809 Nov 16 16:04:49.257584 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-46b561bc-2c00-4a67-95fa-b35dd22a96ef req-d19cc0a8-9b76-4f57-be0e-004f35d850aa service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048545 Nov 16 16:04:49.258184 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 82/171] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:04:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:04:49.316831 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b6c8e035-db77-4f50-8d63-3a52a8e5290c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:04:49.317743 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b6c8e035-db77-4f50-8d63-3a52a8e5290c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:49.324249 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b6c8e035-db77-4f50-8d63-3a52a8e5290c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:49.324688 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b6c8e035-db77-4f50-8d63-3a52a8e5290c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:49.325669 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b6c8e035-db77-4f50-8d63-3a52a8e5290c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:49.326294 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b6c8e035-db77-4f50-8d63-3a52a8e5290c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:49.393146 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-635ff19b-6671-483d-83fb-ff885eecaf7d tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:49.393849 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-635ff19b-6671-483d-83fb-ff885eecaf7d tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:49.399973 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-635ff19b-6671-483d-83fb-ff885eecaf7d tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:49.400421 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-635ff19b-6671-483d-83fb-ff885eecaf7d tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:49.401322 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-635ff19b-6671-483d-83fb-ff885eecaf7d tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:49.401700 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-635ff19b-6671-483d-83fb-ff885eecaf7d tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:49.423197 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b6c8e035-db77-4f50-8d63-3a52a8e5290c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action" status: 200 len: 14 microversion: 2.1 time: 0.109755 Nov 16 16:04:49.426328 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 90/172] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:04:49 2021] POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 16:04:49.566907 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-635ff19b-6671-483d-83fb-ff885eecaf7d tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:49.589749 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-635ff19b-6671-483d-83fb-ff885eecaf7d tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248" status: 200 len: 1522 microversion: 2.1 time: 0.200800 Nov 16 16:04:49.591770 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 83/173] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:49 2021] GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:04:49.963095 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e1dca93c-32b4-4939-bbcc-9d21858b7791 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:04:49.964229 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e1dca93c-32b4-4939-bbcc-9d21858b7791 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:49.981149 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e1dca93c-32b4-4939-bbcc-9d21858b7791 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:49.981901 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e1dca93c-32b4-4939-bbcc-9d21858b7791 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:49.984607 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e1dca93c-32b4-4939-bbcc-9d21858b7791 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:49.985544 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e1dca93c-32b4-4939-bbcc-9d21858b7791 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:50.038128 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-7579a22c-155b-4344-b749-335b443a32b7 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:50.038782 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-7579a22c-155b-4344-b749-335b443a32b7 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] [instance: fe8f46c2-6a46-484f-8b50-29407c7207c7] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:50.047998 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7579a22c-155b-4344-b749-335b443a32b7 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:50.051930 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7579a22c-155b-4344-b749-335b443a32b7 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:50.053164 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7579a22c-155b-4344-b749-335b443a32b7 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:50.053814 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7579a22c-155b-4344-b749-335b443a32b7 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:50.090010 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e1dca93c-32b4-4939-bbcc-9d21858b7791 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action" status: 200 len: 14 microversion: 2.20 time: 0.132698 Nov 16 16:04:50.090010 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 91/174] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:04:49 2021] POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:50.222648 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-7579a22c-155b-4344-b749-335b443a32b7 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baeb57cceead4eda9ec354d996c7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52edf438b5b545dfaa8dcdba31441017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:50.233183 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-7579a22c-155b-4344-b749-335b443a32b7 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] 10.222.0.46 "GET /compute/v2.1/servers/fe8f46c2-6a46-484f-8b50-29407c7207c7" status: 200 len: 1470 microversion: 2.1 time: 0.198729 Nov 16 16:04:50.235057 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 84/175] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:50 2021] GET /compute/v2.1/servers/fe8f46c2-6a46-484f-8b50-29407c7207c7 => generated 1470 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:04:50.258481 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1891a046-3f1f-4e4d-b054-9c47c4166849 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:50.259281 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1891a046-3f1f-4e4d-b054-9c47c4166849 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] [instance: d8c53b20-4a71-421c-b123-bd5f6ccc6fe0] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:50.267924 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1891a046-3f1f-4e4d-b054-9c47c4166849 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:50.268633 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1891a046-3f1f-4e4d-b054-9c47c4166849 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:50.269483 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1891a046-3f1f-4e4d-b054-9c47c4166849 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:50.269945 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1891a046-3f1f-4e4d-b054-9c47c4166849 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:50.287172 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-1891a046-3f1f-4e4d-b054-9c47c4166849 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] HTTP exception thrown: Instance d8c53b20-4a71-421c-b123-bd5f6ccc6fe0 could not be found. Nov 16 16:04:50.287808 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1891a046-3f1f-4e4d-b054-9c47c4166849 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Returning 404 to user: Instance d8c53b20-4a71-421c-b123-bd5f6ccc6fe0 could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:04:50.288721 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1891a046-3f1f-4e4d-b054-9c47c4166849 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] 10.222.0.46 "GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0" status: 404 len: 111 microversion: 2.1 time: 0.034312 Nov 16 16:04:50.289436 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 92/176] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:50 2021] GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:04:50.423179 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-511def33-4dc2-4fa7-babe-a52ed818b466 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:50.424375 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-511def33-4dc2-4fa7-babe-a52ed818b466 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] [instance: d8c53b20-4a71-421c-b123-bd5f6ccc6fe0] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:50.433638 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-511def33-4dc2-4fa7-babe-a52ed818b466 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:50.434469 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-511def33-4dc2-4fa7-babe-a52ed818b466 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:50.435589 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-511def33-4dc2-4fa7-babe-a52ed818b466 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:50.436209 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-511def33-4dc2-4fa7-babe-a52ed818b466 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:50.441026 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a1de66ae-7ed9-409f-88e4-85c8c836f8b1 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:04:50.442444 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-a1de66ae-7ed9-409f-88e4-85c8c836f8b1 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:50.451583 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a1de66ae-7ed9-409f-88e4-85c8c836f8b1 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:50.453654 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a1de66ae-7ed9-409f-88e4-85c8c836f8b1 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:50.453995 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.wsgi [None req-511def33-4dc2-4fa7-babe-a52ed818b466 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] HTTP exception thrown: Instance d8c53b20-4a71-421c-b123-bd5f6ccc6fe0 could not be found. Nov 16 16:04:50.454518 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-511def33-4dc2-4fa7-babe-a52ed818b466 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Returning 404 to user: Instance d8c53b20-4a71-421c-b123-bd5f6ccc6fe0 could not be found. {{(pid=116085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:04:50.455687 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a1de66ae-7ed9-409f-88e4-85c8c836f8b1 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:50.455817 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-511def33-4dc2-4fa7-babe-a52ed818b466 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] 10.222.0.46 "GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.037035 Nov 16 16:04:50.459777 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 85/177] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 16 16:04:50 2021] GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0/os-volume_attachments => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:04:50.460599 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a1de66ae-7ed9-409f-88e4-85c8c836f8b1 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:50.608472 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-2ab22526-3f2c-4f9f-8084-ffb9ea514fe0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:50.610123 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-2ab22526-3f2c-4f9f-8084-ffb9ea514fe0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:50.616810 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2ab22526-3f2c-4f9f-8084-ffb9ea514fe0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:50.617439 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2ab22526-3f2c-4f9f-8084-ffb9ea514fe0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:50.618372 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2ab22526-3f2c-4f9f-8084-ffb9ea514fe0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:50.618949 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2ab22526-3f2c-4f9f-8084-ffb9ea514fe0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:50.764638 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-2ab22526-3f2c-4f9f-8084-ffb9ea514fe0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:50.772682 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-2ab22526-3f2c-4f9f-8084-ffb9ea514fe0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248" status: 200 len: 1522 microversion: 2.1 time: 0.168413 Nov 16 16:04:50.773256 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 86/178] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:50 2021] GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:51.100883 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-8a0b3382-6b85-4c72-bcce-55d1d70b99d5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:04:51.101780 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-8a0b3382-6b85-4c72-bcce-55d1d70b99d5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:51.108135 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8a0b3382-6b85-4c72-bcce-55d1d70b99d5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:51.108695 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8a0b3382-6b85-4c72-bcce-55d1d70b99d5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:51.109949 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8a0b3382-6b85-4c72-bcce-55d1d70b99d5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:51.110380 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8a0b3382-6b85-4c72-bcce-55d1d70b99d5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:53.255416 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-a1de66ae-7ed9-409f-88e4-85c8c836f8b1 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action" status: 200 len: 14 microversion: 2.1 time: 2.821750 Nov 16 16:04:53.259625 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-8a0b3382-6b85-4c72-bcce-55d1d70b99d5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action" status: 200 len: 14 microversion: 2.20 time: 2.161002 Nov 16 16:04:53.259625 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 87/179] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:04:51 2021] POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action => generated 14 bytes in 2163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:04:53.263475 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 93/180] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:04:50 2021] POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action => generated 14 bytes in 2831 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 16:04:53.268144 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-01c5f7fd-0793-44a3-a9e7-f5af82b46940 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:53.268852 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-01c5f7fd-0793-44a3-a9e7-f5af82b46940 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] [instance: fe8f46c2-6a46-484f-8b50-29407c7207c7] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:53.270294 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-57be4c90-1ddb-49a9-b9f3-ec0af54f52fd req-79a91d02-0faa-45c5-b94c-ad70ed9c3470 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe8f46c2-6a46-484f-8b50-29407c7207c7", "name": "network-vif-deleted", "tag": "30f5ecc5-351c-4279-9dc1-cc7b6e72b52e"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:04:53.272022 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:04:53.272022 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Nov 16 16:04:53.277269 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-01c5f7fd-0793-44a3-a9e7-f5af82b46940 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:53.278320 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-01c5f7fd-0793-44a3-a9e7-f5af82b46940 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:53.279267 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-01c5f7fd-0793-44a3-a9e7-f5af82b46940 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:53.279985 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-01c5f7fd-0793-44a3-a9e7-f5af82b46940 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:53.280485 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-57be4c90-1ddb-49a9-b9f3-ec0af54f52fd req-79a91d02-0faa-45c5-b94c-ad70ed9c3470 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:53.280934 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-57be4c90-1ddb-49a9-b9f3-ec0af54f52fd req-79a91d02-0faa-45c5-b94c-ad70ed9c3470 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:53.293394 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-57be4c90-1ddb-49a9-b9f3-ec0af54f52fd req-79a91d02-0faa-45c5-b94c-ad70ed9c3470 service nova] Creating event network-vif-deleted:30f5ecc5-351c-4279-9dc1-cc7b6e72b52e for instance fe8f46c2-6a46-484f-8b50-29407c7207c7 on hv-cinder-81809 Nov 16 16:04:53.300171 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-57be4c90-1ddb-49a9-b9f3-ec0af54f52fd req-79a91d02-0faa-45c5-b94c-ad70ed9c3470 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035062 Nov 16 16:04:53.301050 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 94/181] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:04:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:04:53.308724 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-472d75b3-e2c2-4101-b3ed-8de2c37cf0f0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:53.314448 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-472d75b3-e2c2-4101-b3ed-8de2c37cf0f0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:53.317307 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-01c5f7fd-0793-44a3-a9e7-f5af82b46940 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:53.318011 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-01c5f7fd-0793-44a3-a9e7-f5af82b46940 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:53.318718 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.objects.instance [None req-01c5f7fd-0793-44a3-a9e7-f5af82b46940 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lazy-loading 'fault' on Instance uuid fe8f46c2-6a46-484f-8b50-29407c7207c7 {{(pid=116085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:04:53.322130 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-472d75b3-e2c2-4101-b3ed-8de2c37cf0f0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:53.323364 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-472d75b3-e2c2-4101-b3ed-8de2c37cf0f0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:53.324438 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-472d75b3-e2c2-4101-b3ed-8de2c37cf0f0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:53.325108 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-472d75b3-e2c2-4101-b3ed-8de2c37cf0f0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:53.374238 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-01c5f7fd-0793-44a3-a9e7-f5af82b46940 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baeb57cceead4eda9ec354d996c7876c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52edf438b5b545dfaa8dcdba31441017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:53.382414 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-01c5f7fd-0793-44a3-a9e7-f5af82b46940 tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] 10.222.0.46 "GET /compute/v2.1/servers/fe8f46c2-6a46-484f-8b50-29407c7207c7" status: 200 len: 1304 microversion: 2.1 time: 0.121939 Nov 16 16:04:53.383004 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 88/182] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:53 2021] GET /compute/v2.1/servers/fe8f46c2-6a46-484f-8b50-29407c7207c7 => generated 1304 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:53.485944 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-472d75b3-e2c2-4101-b3ed-8de2c37cf0f0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:53.493762 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-472d75b3-e2c2-4101-b3ed-8de2c37cf0f0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248" status: 200 len: 1522 microversion: 2.1 time: 0.191447 Nov 16 16:04:53.494414 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 95/183] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:53 2021] GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:53.754893 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-db547895-4794-46f4-84a1-6975218eb306 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:53.755384 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-db547895-4794-46f4-84a1-6975218eb306 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] [instance: d8c53b20-4a71-421c-b123-bd5f6ccc6fe0] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:53.767632 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-db547895-4794-46f4-84a1-6975218eb306 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:53.768344 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-db547895-4794-46f4-84a1-6975218eb306 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:53.769453 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-db547895-4794-46f4-84a1-6975218eb306 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:53.770091 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-db547895-4794-46f4-84a1-6975218eb306 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:53.786723 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.wsgi [None req-db547895-4794-46f4-84a1-6975218eb306 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] HTTP exception thrown: Instance d8c53b20-4a71-421c-b123-bd5f6ccc6fe0 could not be found. Nov 16 16:04:53.787582 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-db547895-4794-46f4-84a1-6975218eb306 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Returning 404 to user: Instance d8c53b20-4a71-421c-b123-bd5f6ccc6fe0 could not be found. {{(pid=116085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:04:53.788412 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-db547895-4794-46f4-84a1-6975218eb306 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0" status: 404 len: 111 microversion: 2.1 time: 0.037375 Nov 16 16:04:53.789297 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 89/184] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 16 16:04:53 2021] DELETE /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:04:53.796882 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a18a969b-4621-4e67-b04d-24c138ed2bb0 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:53.797581 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-a18a969b-4621-4e67-b04d-24c138ed2bb0 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] [instance: d8c53b20-4a71-421c-b123-bd5f6ccc6fe0] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:53.803890 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a18a969b-4621-4e67-b04d-24c138ed2bb0 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:53.804370 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a18a969b-4621-4e67-b04d-24c138ed2bb0 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:53.805283 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a18a969b-4621-4e67-b04d-24c138ed2bb0 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:53.806001 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a18a969b-4621-4e67-b04d-24c138ed2bb0 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:53.820278 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-a18a969b-4621-4e67-b04d-24c138ed2bb0 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] HTTP exception thrown: Instance d8c53b20-4a71-421c-b123-bd5f6ccc6fe0 could not be found. Nov 16 16:04:53.821261 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a18a969b-4621-4e67-b04d-24c138ed2bb0 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] Returning 404 to user: Instance d8c53b20-4a71-421c-b123-bd5f6ccc6fe0 could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:04:53.822504 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-a18a969b-4621-4e67-b04d-24c138ed2bb0 tempest-DeleteServersTestJSON-384754223 tempest-DeleteServersTestJSON-384754223-project] 10.222.0.46 "GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0" status: 404 len: 111 microversion: 2.1 time: 0.029191 Nov 16 16:04:53.823166 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 96/185] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:53 2021] GET /compute/v2.1/servers/d8c53b20-4a71-421c-b123-bd5f6ccc6fe0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:04:54.273452 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-02cc5032-3002-4073-90c1-ed4eb51b2959 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:04:54.274382 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-02cc5032-3002-4073-90c1-ed4eb51b2959 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:54.276135 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-054cfba8-9cd5-41ed-abaf-d298146e9975 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:04:54.277944 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-054cfba8-9cd5-41ed-abaf-d298146e9975 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:54.284905 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-02cc5032-3002-4073-90c1-ed4eb51b2959 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:54.285358 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-02cc5032-3002-4073-90c1-ed4eb51b2959 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:54.285718 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-054cfba8-9cd5-41ed-abaf-d298146e9975 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:54.286153 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-02cc5032-3002-4073-90c1-ed4eb51b2959 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:54.286588 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-02cc5032-3002-4073-90c1-ed4eb51b2959 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:54.286820 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-054cfba8-9cd5-41ed-abaf-d298146e9975 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:54.287846 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-054cfba8-9cd5-41ed-abaf-d298146e9975 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:54.288486 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-054cfba8-9cd5-41ed-abaf-d298146e9975 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:54.360515 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-02cc5032-3002-4073-90c1-ed4eb51b2959 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action" status: 200 len: 14 microversion: 2.1 time: 0.094604 Nov 16 16:04:54.361728 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 90/186] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:04:54 2021] POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 16:04:54.369933 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-054cfba8-9cd5-41ed-abaf-d298146e9975 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action" status: 200 len: 14 microversion: 2.20 time: 0.103349 Nov 16 16:04:54.375007 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 97/187] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:04:54 2021] POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:54.400261 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-10ca1b11-2935-492f-8866-334e8738914d tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:54.401474 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-10ca1b11-2935-492f-8866-334e8738914d tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] [instance: fe8f46c2-6a46-484f-8b50-29407c7207c7] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:54.409324 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-10ca1b11-2935-492f-8866-334e8738914d tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:54.409772 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-10ca1b11-2935-492f-8866-334e8738914d tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:54.410548 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-10ca1b11-2935-492f-8866-334e8738914d tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:54.411261 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-10ca1b11-2935-492f-8866-334e8738914d tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:54.428254 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.wsgi [None req-10ca1b11-2935-492f-8866-334e8738914d tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] HTTP exception thrown: Instance fe8f46c2-6a46-484f-8b50-29407c7207c7 could not be found. Nov 16 16:04:54.429169 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-10ca1b11-2935-492f-8866-334e8738914d tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] Returning 404 to user: Instance fe8f46c2-6a46-484f-8b50-29407c7207c7 could not be found. {{(pid=116085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:04:54.430197 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-10ca1b11-2935-492f-8866-334e8738914d tempest-VolumesNegativeTest-303315713 tempest-VolumesNegativeTest-303315713-project] 10.222.0.46 "GET /compute/v2.1/servers/fe8f46c2-6a46-484f-8b50-29407c7207c7" status: 404 len: 111 microversion: 2.1 time: 0.034040 Nov 16 16:04:54.436352 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 91/188] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:54 2021] GET /compute/v2.1/servers/fe8f46c2-6a46-484f-8b50-29407c7207c7 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:04:54.515581 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e4d6700c-12cb-47ce-a996-e3f67c83b8dd tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:54.515581 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e4d6700c-12cb-47ce-a996-e3f67c83b8dd tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:54.523361 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e4d6700c-12cb-47ce-a996-e3f67c83b8dd tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:54.523840 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e4d6700c-12cb-47ce-a996-e3f67c83b8dd tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:54.524650 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e4d6700c-12cb-47ce-a996-e3f67c83b8dd tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:54.525208 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e4d6700c-12cb-47ce-a996-e3f67c83b8dd tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:54.781903 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e4d6700c-12cb-47ce-a996-e3f67c83b8dd tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:54.789976 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e4d6700c-12cb-47ce-a996-e3f67c83b8dd tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248" status: 200 len: 1522 microversion: 2.1 time: 0.282406 Nov 16 16:04:54.791604 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 98/189] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:54 2021] GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248 => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:55.373934 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-8d269b58-e61f-40fe-89a0-4696bb8bdba3 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:04:55.375004 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-8d269b58-e61f-40fe-89a0-4696bb8bdba3 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:55.383512 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-fba1d1ca-ee5f-41ff-8ad6-2f25c74c967e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:04:55.385255 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-fba1d1ca-ee5f-41ff-8ad6-2f25c74c967e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:55.392954 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fba1d1ca-ee5f-41ff-8ad6-2f25c74c967e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:55.393654 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fba1d1ca-ee5f-41ff-8ad6-2f25c74c967e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:55.394745 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fba1d1ca-ee5f-41ff-8ad6-2f25c74c967e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:55.395283 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8d269b58-e61f-40fe-89a0-4696bb8bdba3 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:55.395693 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8d269b58-e61f-40fe-89a0-4696bb8bdba3 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:55.396410 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fba1d1ca-ee5f-41ff-8ad6-2f25c74c967e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:55.396941 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8d269b58-e61f-40fe-89a0-4696bb8bdba3 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:55.397646 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8d269b58-e61f-40fe-89a0-4696bb8bdba3 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:57.923305 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-8d269b58-e61f-40fe-89a0-4696bb8bdba3 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action" status: 200 len: 14 microversion: 2.1 time: 2.552612 Nov 16 16:04:57.924158 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 92/190] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:04:55 2021] POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action => generated 14 bytes in 2554 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 16:04:57.929420 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-4e4fb491-11b8-4160-b275-67cd415fcb7c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:57.930120 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-4e4fb491-11b8-4160-b275-67cd415fcb7c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:57.936798 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-fba1d1ca-ee5f-41ff-8ad6-2f25c74c967e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action" status: 200 len: 14 microversion: 2.20 time: 2.557674 Nov 16 16:04:57.937685 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4e4fb491-11b8-4160-b275-67cd415fcb7c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:57.938420 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4e4fb491-11b8-4160-b275-67cd415fcb7c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:57.938563 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 99/191] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:04:55 2021] POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action => generated 14 bytes in 2560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:04:57.939612 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4e4fb491-11b8-4160-b275-67cd415fcb7c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:57.940054 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4e4fb491-11b8-4160-b275-67cd415fcb7c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:58.060272 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a69ec951-ad15-49a3-9b34-f0f4909d8e81 tempest-VolumesGetTestJSON-1582379340 tempest-VolumesGetTestJSON-1582379340-project] Action: 'create', calling method: .version_select at 0x7f113c610550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-548527939", "metadata": {"Type": "work"}}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:04:58.078111 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-4e4fb491-11b8-4160-b275-67cd415fcb7c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:58.086831 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-4e4fb491-11b8-4160-b275-67cd415fcb7c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248" status: 200 len: 1522 microversion: 2.1 time: 0.161475 Nov 16 16:04:58.087506 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 93/192] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:57 2021] GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:58.373110 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-a69ec951-ad15-49a3-9b34-f0f4909d8e81 tempest-VolumesGetTestJSON-1582379340 tempest-VolumesGetTestJSON-1582379340-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.431840 Nov 16 16:04:58.373850 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 100/193] 10.222.0.46 () {60 vars in 1155 bytes} [Tue Nov 16 16:04:57 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 435 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 16 16:04:58.385585 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-5d0d8909-670c-4528-9800-4f60cd335d72 tempest-VolumesGetTestJSON-1582379340 tempest-VolumesGetTestJSON-1582379340-project] Calling method '.version_select at 0x7f113c648280>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:58.439210 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-5d0d8909-670c-4528-9800-4f60cd335d72 tempest-VolumesGetTestJSON-1582379340 tempest-VolumesGetTestJSON-1582379340-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/cd181ac1-cad0-4923-acb3-890c9b681082" status: 200 len: 352 microversion: 2.1 time: 0.057204 Nov 16 16:04:58.444387 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 94/194] 10.222.0.46 () {58 vars in 1244 bytes} [Tue Nov 16 16:04:58 2021] GET /compute/v2.1/os-volumes/cd181ac1-cad0-4923-acb3-890c9b681082 => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:04:58.935601 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f966f1a8-a009-480b-b41b-cf8193b2dbeb tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:04:58.936912 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f966f1a8-a009-480b-b41b-cf8193b2dbeb tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:58.945371 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f966f1a8-a009-480b-b41b-cf8193b2dbeb tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:58.946197 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f966f1a8-a009-480b-b41b-cf8193b2dbeb tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:58.947293 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f966f1a8-a009-480b-b41b-cf8193b2dbeb tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:58.948000 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f966f1a8-a009-480b-b41b-cf8193b2dbeb tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:58.949520 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-4b3ed73d-7456-4075-9fc9-6ac1eb33a9d2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:04:58.951526 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-4b3ed73d-7456-4075-9fc9-6ac1eb33a9d2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:58.960039 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4b3ed73d-7456-4075-9fc9-6ac1eb33a9d2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:58.960875 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4b3ed73d-7456-4075-9fc9-6ac1eb33a9d2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:58.961853 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4b3ed73d-7456-4075-9fc9-6ac1eb33a9d2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:58.962424 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4b3ed73d-7456-4075-9fc9-6ac1eb33a9d2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:59.031854 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f966f1a8-a009-480b-b41b-cf8193b2dbeb tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action" status: 200 len: 14 microversion: 2.1 time: 0.100164 Nov 16 16:04:59.036586 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 101/195] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:04:58 2021] POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 16:04:59.042054 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-4b3ed73d-7456-4075-9fc9-6ac1eb33a9d2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action" status: 200 len: 14 microversion: 2.20 time: 0.096500 Nov 16 16:04:59.043271 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 95/196] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:04:58 2021] POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:59.106569 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-352f4383-c987-4b71-8bee-dd5330409344 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:59.107446 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-352f4383-c987-4b71-8bee-dd5330409344 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:04:59.116376 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-352f4383-c987-4b71-8bee-dd5330409344 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:59.116824 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-352f4383-c987-4b71-8bee-dd5330409344 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:59.117611 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-352f4383-c987-4b71-8bee-dd5330409344 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:04:59.118522 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-352f4383-c987-4b71-8bee-dd5330409344 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:04:59.325655 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-352f4383-c987-4b71-8bee-dd5330409344 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:04:59.337444 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-352f4383-c987-4b71-8bee-dd5330409344 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248" status: 200 len: 1522 microversion: 2.1 time: 0.234717 Nov 16 16:04:59.338201 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 102/197] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:04:59 2021] GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:04:59.461918 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-2870aba5-2ff4-4fdb-88c4-ceb2952a8c76 tempest-VolumesGetTestJSON-1582379340 tempest-VolumesGetTestJSON-1582379340-project] Calling method '.version_select at 0x7f113c755ee0>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:59.530600 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-2870aba5-2ff4-4fdb-88c4-ceb2952a8c76 tempest-VolumesGetTestJSON-1582379340 tempest-VolumesGetTestJSON-1582379340-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/cd181ac1-cad0-4923-acb3-890c9b681082" status: 200 len: 353 microversion: 2.1 time: 0.081970 Nov 16 16:04:59.531429 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 96/198] 10.222.0.46 () {58 vars in 1244 bytes} [Tue Nov 16 16:04:59 2021] GET /compute/v2.1/os-volumes/cd181ac1-cad0-4923-acb3-890c9b681082 => generated 353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:04:59.544125 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-2321a248-80e9-4545-9feb-761701f80db5 tempest-VolumesGetTestJSON-1582379340 tempest-VolumesGetTestJSON-1582379340-project] Calling method '.version_select at 0x7f113c5ca700>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:59.609243 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-2321a248-80e9-4545-9feb-761701f80db5 tempest-VolumesGetTestJSON-1582379340 tempest-VolumesGetTestJSON-1582379340-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/cd181ac1-cad0-4923-acb3-890c9b681082" status: 200 len: 353 microversion: 2.1 time: 0.069825 Nov 16 16:04:59.609810 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 103/199] 10.222.0.46 () {58 vars in 1244 bytes} [Tue Nov 16 16:04:59 2021] GET /compute/v2.1/os-volumes/cd181ac1-cad0-4923-acb3-890c9b681082 => generated 353 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:04:59.628457 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-c87a5dbf-805b-4eee-b29b-3e7e5b39aa3d tempest-VolumesGetTestJSON-1582379340 tempest-VolumesGetTestJSON-1582379340-project] Calling method '.version_select at 0x7f113c63c040>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:59.707007 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-c87a5dbf-805b-4eee-b29b-3e7e5b39aa3d tempest-VolumesGetTestJSON-1582379340 tempest-VolumesGetTestJSON-1582379340-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/cd181ac1-cad0-4923-acb3-890c9b681082" status: 202 len: 0 microversion: 2.1 time: 0.083420 Nov 16 16:04:59.710929 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 97/200] 10.222.0.46 () {58 vars in 1247 bytes} [Tue Nov 16 16:04:59 2021] DELETE /compute/v2.1/os-volumes/cd181ac1-cad0-4923-acb3-890c9b681082 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:04:59.716365 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3b050245-4f9f-4362-97dc-f101007c38eb tempest-VolumesGetTestJSON-1582379340 tempest-VolumesGetTestJSON-1582379340-project] Calling method '.version_select at 0x7f113c5f7c10>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:04:59.772099 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-3b050245-4f9f-4362-97dc-f101007c38eb tempest-VolumesGetTestJSON-1582379340 tempest-VolumesGetTestJSON-1582379340-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/cd181ac1-cad0-4923-acb3-890c9b681082" status: 200 len: 352 microversion: 2.1 time: 0.059302 Nov 16 16:04:59.772751 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 104/201] 10.222.0.46 () {58 vars in 1244 bytes} [Tue Nov 16 16:04:59 2021] GET /compute/v2.1/os-volumes/cd181ac1-cad0-4923-acb3-890c9b681082 => generated 352 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:05:00.044340 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-90d3e4be-06dc-4fc5-8af8-f15d8495103d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:00.045366 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-90d3e4be-06dc-4fc5-8af8-f15d8495103d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:00.054835 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-90d3e4be-06dc-4fc5-8af8-f15d8495103d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:00.055008 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-8c9aa419-001f-4494-9fac-20ad47f66d01 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:00.055883 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-8c9aa419-001f-4494-9fac-20ad47f66d01 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:00.056190 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-90d3e4be-06dc-4fc5-8af8-f15d8495103d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:00.057226 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-90d3e4be-06dc-4fc5-8af8-f15d8495103d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:00.057806 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-90d3e4be-06dc-4fc5-8af8-f15d8495103d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:00.061932 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8c9aa419-001f-4494-9fac-20ad47f66d01 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:00.062381 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8c9aa419-001f-4494-9fac-20ad47f66d01 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:00.063321 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8c9aa419-001f-4494-9fac-20ad47f66d01 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:00.063985 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8c9aa419-001f-4494-9fac-20ad47f66d01 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:02.776899 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-90d3e4be-06dc-4fc5-8af8-f15d8495103d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action" status: 200 len: 13651 microversion: 2.1 time: 2.736442 Nov 16 16:05:02.782819 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 98/202] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:05:00 2021] POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action => generated 13651 bytes in 2743 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:05:02.788265 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-529a59b5-40b1-4621-ae95-6f35d4a4613b tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:02.789182 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-529a59b5-40b1-4621-ae95-6f35d4a4613b tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:02.796006 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-529a59b5-40b1-4621-ae95-6f35d4a4613b tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:02.802415 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-529a59b5-40b1-4621-ae95-6f35d4a4613b tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:02.803559 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-529a59b5-40b1-4621-ae95-6f35d4a4613b tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:02.804953 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-529a59b5-40b1-4621-ae95-6f35d4a4613b tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:02.805855 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-8c9aa419-001f-4494-9fac-20ad47f66d01 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action" status: 200 len: 15025 microversion: 2.20 time: 2.754586 Nov 16 16:05:02.806601 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 105/203] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:05:00 2021] POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action => generated 15025 bytes in 2756 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 16 16:05:02.818277 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-12efabdc-103a-4a84-8f01-b1e09c1786dd tempest-VolumesGetTestJSON-1582379340 tempest-VolumesGetTestJSON-1582379340-project] Calling method '.version_select at 0x7f113c5cac10>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:02.883776 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-12efabdc-103a-4a84-8f01-b1e09c1786dd tempest-VolumesGetTestJSON-1582379340 tempest-VolumesGetTestJSON-1582379340-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/cd181ac1-cad0-4923-acb3-890c9b681082" status: 200 len: 352 microversion: 2.1 time: 0.075876 Nov 16 16:05:02.884518 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 106/204] 10.222.0.46 () {58 vars in 1244 bytes} [Tue Nov 16 16:05:02 2021] GET /compute/v2.1/os-volumes/cd181ac1-cad0-4923-acb3-890c9b681082 => generated 352 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:05:03.114989 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-529a59b5-40b1-4621-ae95-6f35d4a4613b tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:03.125166 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-529a59b5-40b1-4621-ae95-6f35d4a4613b tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248" status: 200 len: 1522 microversion: 2.1 time: 0.340292 Nov 16 16:05:03.142092 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 99/205] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:02 2021] GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248 => generated 1522 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:05:03.791994 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-4a42c3eb-949c-4662-80a1-6ef1b12cc5c8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:03.793569 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-4a42c3eb-949c-4662-80a1-6ef1b12cc5c8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:03.807449 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4a42c3eb-949c-4662-80a1-6ef1b12cc5c8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:03.809433 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4a42c3eb-949c-4662-80a1-6ef1b12cc5c8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:03.810484 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4a42c3eb-949c-4662-80a1-6ef1b12cc5c8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:03.819984 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-5ceac444-2262-4310-bc39-567a0b8bacec tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:03.821514 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-5ceac444-2262-4310-bc39-567a0b8bacec tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:03.828381 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4a42c3eb-949c-4662-80a1-6ef1b12cc5c8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:03.837354 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5ceac444-2262-4310-bc39-567a0b8bacec tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:03.847836 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5ceac444-2262-4310-bc39-567a0b8bacec tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:03.849953 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5ceac444-2262-4310-bc39-567a0b8bacec tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:03.851103 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5ceac444-2262-4310-bc39-567a0b8bacec tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:03.962873 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-5ceac444-2262-4310-bc39-567a0b8bacec tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action" status: 200 len: 17861 microversion: 2.20 time: 0.147604 Nov 16 16:05:03.963191 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 100/206] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:05:03 2021] POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action => generated 17861 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 16 16:05:03.968592 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-e49af6b8-3e64-4dba-bc59-d42616ec4c39 tempest-VolumesGetTestJSON-1582379340 tempest-VolumesGetTestJSON-1582379340-project] Calling method '.version_select at 0x7f113c63caf0>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:03.992946 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-4a42c3eb-949c-4662-80a1-6ef1b12cc5c8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action" status: 200 len: 17602 microversion: 2.1 time: 0.206118 Nov 16 16:05:03.994014 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 107/207] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:05:03 2021] POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action => generated 17602 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:05:04.033619 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.wsgi [None req-e49af6b8-3e64-4dba-bc59-d42616ec4c39 tempest-VolumesGetTestJSON-1582379340 tempest-VolumesGetTestJSON-1582379340-project] HTTP exception thrown: Volume cd181ac1-cad0-4923-acb3-890c9b681082 could not be found. Nov 16 16:05:04.034763 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-e49af6b8-3e64-4dba-bc59-d42616ec4c39 tempest-VolumesGetTestJSON-1582379340 tempest-VolumesGetTestJSON-1582379340-project] Returning 404 to user: Volume cd181ac1-cad0-4923-acb3-890c9b681082 could not be found. {{(pid=116085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:05:04.036555 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-e49af6b8-3e64-4dba-bc59-d42616ec4c39 tempest-VolumesGetTestJSON-1582379340 tempest-VolumesGetTestJSON-1582379340-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/cd181ac1-cad0-4923-acb3-890c9b681082" status: 404 len: 109 microversion: 2.1 time: 0.071438 Nov 16 16:05:04.037596 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 101/208] 10.222.0.46 () {58 vars in 1244 bytes} [Tue Nov 16 16:05:03 2021] GET /compute/v2.1/os-volumes/cd181ac1-cad0-4923-acb3-890c9b681082 => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:05:04.159807 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1c627963-8f54-4de2-9075-472120d9f93e tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:04.160727 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1c627963-8f54-4de2-9075-472120d9f93e tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:04.174408 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1c627963-8f54-4de2-9075-472120d9f93e tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:04.175343 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1c627963-8f54-4de2-9075-472120d9f93e tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:04.176582 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1c627963-8f54-4de2-9075-472120d9f93e tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:04.177028 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1c627963-8f54-4de2-9075-472120d9f93e tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:04.534451 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1c627963-8f54-4de2-9075-472120d9f93e tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:04.544108 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1c627963-8f54-4de2-9075-472120d9f93e tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248" status: 200 len: 1522 microversion: 2.1 time: 0.388608 Nov 16 16:05:04.545298 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 108/209] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:04 2021] GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248 => generated 1522 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:05:04.980738 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-4ac254e3-be4c-44f2-a38c-6f97238b1e28 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:04.981880 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-4ac254e3-be4c-44f2-a38c-6f97238b1e28 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:04.994417 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4ac254e3-be4c-44f2-a38c-6f97238b1e28 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:04.995223 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4ac254e3-be4c-44f2-a38c-6f97238b1e28 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:04.997028 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4ac254e3-be4c-44f2-a38c-6f97238b1e28 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:05.006069 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1efa3563-5b6e-4cf9-ae39-d7aafd12b981 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:05.006992 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1efa3563-5b6e-4cf9-ae39-d7aafd12b981 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:05.013714 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4ac254e3-be4c-44f2-a38c-6f97238b1e28 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:05.041833 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1efa3563-5b6e-4cf9-ae39-d7aafd12b981 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:05.044379 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1efa3563-5b6e-4cf9-ae39-d7aafd12b981 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:05.045202 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1efa3563-5b6e-4cf9-ae39-d7aafd12b981 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:05.045642 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1efa3563-5b6e-4cf9-ae39-d7aafd12b981 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:05.156002 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-4ac254e3-be4c-44f2-a38c-6f97238b1e28 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action" status: 200 len: 18777 microversion: 2.20 time: 0.182239 Nov 16 16:05:05.158235 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 102/210] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:05:04 2021] POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action => generated 18777 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:05:05.188345 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1efa3563-5b6e-4cf9-ae39-d7aafd12b981 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action" status: 200 len: 17861 microversion: 2.1 time: 0.187460 Nov 16 16:05:05.190386 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 109/211] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:05:04 2021] POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action => generated 17861 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:05:05.562612 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-5f65a292-0dbf-4b16-ab04-712d269d144f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:05.564203 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-5f65a292-0dbf-4b16-ab04-712d269d144f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:05.580426 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5f65a292-0dbf-4b16-ab04-712d269d144f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:05.580992 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5f65a292-0dbf-4b16-ab04-712d269d144f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:05.581898 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5f65a292-0dbf-4b16-ab04-712d269d144f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:05.587694 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5f65a292-0dbf-4b16-ab04-712d269d144f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:05.825778 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-5f65a292-0dbf-4b16-ab04-712d269d144f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:05.835720 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-5f65a292-0dbf-4b16-ab04-712d269d144f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248" status: 200 len: 1522 microversion: 2.1 time: 0.277001 Nov 16 16:05:05.837454 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 103/212] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:05 2021] GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248 => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:05:06.171223 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-9d188523-1102-4c78-a2c3-35088ee213e7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:06.175731 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-9d188523-1102-4c78-a2c3-35088ee213e7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:06.186561 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9d188523-1102-4c78-a2c3-35088ee213e7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:06.188043 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9d188523-1102-4c78-a2c3-35088ee213e7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:06.189146 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9d188523-1102-4c78-a2c3-35088ee213e7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:06.189807 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9d188523-1102-4c78-a2c3-35088ee213e7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:06.202432 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-411bd5ba-140c-4a64-aad1-0347ee436533 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:06.203290 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-411bd5ba-140c-4a64-aad1-0347ee436533 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:06.217378 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-411bd5ba-140c-4a64-aad1-0347ee436533 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:06.217841 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-411bd5ba-140c-4a64-aad1-0347ee436533 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:06.218650 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-411bd5ba-140c-4a64-aad1-0347ee436533 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:06.219083 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-411bd5ba-140c-4a64-aad1-0347ee436533 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:09.191002 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-411bd5ba-140c-4a64-aad1-0347ee436533 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action" status: 200 len: 23812 microversion: 2.1 time: 2.994016 Nov 16 16:05:09.192993 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 104/213] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:05:06 2021] POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action => generated 23812 bytes in 2997 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 16:05:09.198972 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-e409cb11-0b84-4f83-b74e-625388be5c68 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:09.200102 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-e409cb11-0b84-4f83-b74e-625388be5c68 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:09.209492 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e409cb11-0b84-4f83-b74e-625388be5c68 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:09.209702 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-9d188523-1102-4c78-a2c3-35088ee213e7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action" status: 200 len: 24776 microversion: 2.20 time: 3.044863 Nov 16 16:05:09.210364 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 110/214] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:05:06 2021] POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action => generated 24776 bytes in 3047 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:05:09.210851 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e409cb11-0b84-4f83-b74e-625388be5c68 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:09.211967 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e409cb11-0b84-4f83-b74e-625388be5c68 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:09.212770 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e409cb11-0b84-4f83-b74e-625388be5c68 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:09.794227 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-e409cb11-0b84-4f83-b74e-625388be5c68 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:09.803628 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-e409cb11-0b84-4f83-b74e-625388be5c68 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248" status: 200 len: 1522 microversion: 2.1 time: 0.609190 Nov 16 16:05:09.804721 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 105/215] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:09 2021] GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248 => generated 1522 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:05:10.204583 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-028fca18-c49c-4f3b-83de-d73e0464019b tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:10.205909 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-028fca18-c49c-4f3b-83de-d73e0464019b tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:10.224166 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-439f1c3d-5fa5-4945-a76c-629980363e89 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:10.226168 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-439f1c3d-5fa5-4945-a76c-629980363e89 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:10.233263 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-028fca18-c49c-4f3b-83de-d73e0464019b tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:10.237157 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-439f1c3d-5fa5-4945-a76c-629980363e89 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:10.238107 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-439f1c3d-5fa5-4945-a76c-629980363e89 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:10.239123 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-439f1c3d-5fa5-4945-a76c-629980363e89 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:10.239894 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-439f1c3d-5fa5-4945-a76c-629980363e89 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:10.243781 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-028fca18-c49c-4f3b-83de-d73e0464019b tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:10.244647 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-028fca18-c49c-4f3b-83de-d73e0464019b tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:10.245065 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-028fca18-c49c-4f3b-83de-d73e0464019b tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:10.376504 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-439f1c3d-5fa5-4945-a76c-629980363e89 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action" status: 200 len: 25712 microversion: 2.20 time: 0.158849 Nov 16 16:05:10.377269 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 106/216] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:05:10 2021] POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action => generated 25712 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 16 16:05:10.404775 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-028fca18-c49c-4f3b-83de-d73e0464019b tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action" status: 200 len: 24735 microversion: 2.1 time: 0.204482 Nov 16 16:05:10.406260 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 111/217] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:05:10 2021] POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action => generated 24735 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:05:10.830919 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-7cad8545-7ff8-4122-96ac-2fe39b9f2231 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:10.834505 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-7cad8545-7ff8-4122-96ac-2fe39b9f2231 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:10.867320 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7cad8545-7ff8-4122-96ac-2fe39b9f2231 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:10.867788 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7cad8545-7ff8-4122-96ac-2fe39b9f2231 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:10.868599 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7cad8545-7ff8-4122-96ac-2fe39b9f2231 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:10.869043 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7cad8545-7ff8-4122-96ac-2fe39b9f2231 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:11.192895 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-7cad8545-7ff8-4122-96ac-2fe39b9f2231 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:11.205265 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-7cad8545-7ff8-4122-96ac-2fe39b9f2231 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248" status: 200 len: 1522 microversion: 2.1 time: 0.386872 Nov 16 16:05:11.205878 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 107/218] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:10 2021] GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248 => generated 1522 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:05:11.390017 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-23959f7e-867f-4e1d-9097-d5e9b374f0fc tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:11.391742 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-23959f7e-867f-4e1d-9097-d5e9b374f0fc tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:11.403898 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-23959f7e-867f-4e1d-9097-d5e9b374f0fc tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:11.404630 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-23959f7e-867f-4e1d-9097-d5e9b374f0fc tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:11.405637 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-23959f7e-867f-4e1d-9097-d5e9b374f0fc tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:11.406295 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-23959f7e-867f-4e1d-9097-d5e9b374f0fc tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:11.417947 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-d7b22fbb-8402-45a8-97db-09c5a243d6be tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:11.420375 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-d7b22fbb-8402-45a8-97db-09c5a243d6be tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:11.437461 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d7b22fbb-8402-45a8-97db-09c5a243d6be tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:11.438478 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d7b22fbb-8402-45a8-97db-09c5a243d6be tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:11.439864 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d7b22fbb-8402-45a8-97db-09c5a243d6be tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:11.440633 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d7b22fbb-8402-45a8-97db-09c5a243d6be tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:11.529536 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-23959f7e-867f-4e1d-9097-d5e9b374f0fc tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action" status: 200 len: 26467 microversion: 2.20 time: 0.144488 Nov 16 16:05:11.534517 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 112/219] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:05:11 2021] POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action => generated 26467 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:05:11.566007 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-d7b22fbb-8402-45a8-97db-09c5a243d6be tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action" status: 200 len: 25759 microversion: 2.1 time: 0.151757 Nov 16 16:05:11.566982 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 108/220] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:05:11 2021] POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action => generated 25759 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 16:05:12.231344 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f9b281f0-bf41-49af-a3f6-c075a0303ccf tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:12.232455 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f9b281f0-bf41-49af-a3f6-c075a0303ccf tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:12.261674 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f9b281f0-bf41-49af-a3f6-c075a0303ccf tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:12.264200 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f9b281f0-bf41-49af-a3f6-c075a0303ccf tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:12.272867 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f9b281f0-bf41-49af-a3f6-c075a0303ccf tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:12.279331 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f9b281f0-bf41-49af-a3f6-c075a0303ccf tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:12.544161 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-22a36d2b-e944-4bdc-bd12-1a71911543b8 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:12.545311 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-22a36d2b-e944-4bdc-bd12-1a71911543b8 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:12.558424 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-22a36d2b-e944-4bdc-bd12-1a71911543b8 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:12.558867 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-22a36d2b-e944-4bdc-bd12-1a71911543b8 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:12.559696 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-22a36d2b-e944-4bdc-bd12-1a71911543b8 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:12.560093 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-22a36d2b-e944-4bdc-bd12-1a71911543b8 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:12.640269 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f9b281f0-bf41-49af-a3f6-c075a0303ccf tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:12.651489 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f9b281f0-bf41-49af-a3f6-c075a0303ccf tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248" status: 200 len: 1522 microversion: 2.1 time: 0.431807 Nov 16 16:05:12.653073 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 113/221] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:12 2021] GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248 => generated 1522 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:05:12.658371 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-17d85eb7-95a0-41cf-82a4-cb84be2767b7 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:12.659591 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-17d85eb7-95a0-41cf-82a4-cb84be2767b7 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:12.668661 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-17d85eb7-95a0-41cf-82a4-cb84be2767b7 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:12.669294 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-17d85eb7-95a0-41cf-82a4-cb84be2767b7 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:12.670251 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-17d85eb7-95a0-41cf-82a4-cb84be2767b7 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:12.670841 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-17d85eb7-95a0-41cf-82a4-cb84be2767b7 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:15.665577 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-22a36d2b-e944-4bdc-bd12-1a71911543b8 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action" status: 200 len: 27907 microversion: 2.20 time: 3.126482 Nov 16 16:05:15.667330 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 109/222] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:05:12 2021] POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action => generated 27907 bytes in 3129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:05:15.687304 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-17d85eb7-95a0-41cf-82a4-cb84be2767b7 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action" status: 200 len: 27596 microversion: 2.1 time: 3.032663 Nov 16 16:05:15.689383 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 114/223] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:05:12 2021] POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action => generated 27596 bytes in 3035 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:05:15.696162 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-653a421d-af2e-49b7-8733-b57a3ba39f8f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:15.697469 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-653a421d-af2e-49b7-8733-b57a3ba39f8f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:15.706228 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-653a421d-af2e-49b7-8733-b57a3ba39f8f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:15.706935 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-653a421d-af2e-49b7-8733-b57a3ba39f8f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:15.708336 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-653a421d-af2e-49b7-8733-b57a3ba39f8f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:15.709268 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-653a421d-af2e-49b7-8733-b57a3ba39f8f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:15.894127 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-653a421d-af2e-49b7-8733-b57a3ba39f8f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:15.913988 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-c87c73e7-8b39-4b20-bff5-6bff84bcdb0b tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Action: 'create', calling method: .version_select at 0x7f113c670f70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1166381435"}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:15.922093 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-653a421d-af2e-49b7-8733-b57a3ba39f8f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248" status: 200 len: 1522 microversion: 2.1 time: 0.231337 Nov 16 16:05:15.923899 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 115/224] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:15 2021] GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:05:15.941712 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-c87c73e7-8b39-4b20-bff5-6bff84bcdb0b tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Getting quotas for project d2bdf7025cb744f088b95cb0bba5169b. Resources: {'key_pairs'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:05:15.947527 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-c87c73e7-8b39-4b20-bff5-6bff84bcdb0b tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Getting quotas for user d363b1ed870843a6ba751e0d1ea0bd1e and project d2bdf7025cb744f088b95cb0bba5169b. Resources: {'key_pairs'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:05:16.140152 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-c87c73e7-8b39-4b20-bff5-6bff84bcdb0b tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Getting quotas for project d2bdf7025cb744f088b95cb0bba5169b. Resources: {'key_pairs'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:05:16.144708 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-c87c73e7-8b39-4b20-bff5-6bff84bcdb0b tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Getting quotas for user d363b1ed870843a6ba751e0d1ea0bd1e and project d2bdf7025cb744f088b95cb0bba5169b. Resources: {'key_pairs'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:05:16.159757 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-c87c73e7-8b39-4b20-bff5-6bff84bcdb0b tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.490956 Nov 16 16:05:16.160360 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 110/225] 10.222.0.46 () {60 vars in 1157 bytes} [Tue Nov 16 16:05:15 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:05:16.677361 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-cb5780ec-f60b-4811-8b27-666f8ac26b52 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:16.678290 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-cb5780ec-f60b-4811-8b27-666f8ac26b52 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:16.684934 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cb5780ec-f60b-4811-8b27-666f8ac26b52 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:16.685381 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cb5780ec-f60b-4811-8b27-666f8ac26b52 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:16.686160 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cb5780ec-f60b-4811-8b27-666f8ac26b52 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:16.686593 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cb5780ec-f60b-4811-8b27-666f8ac26b52 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:16.714839 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-c329b436-14a3-41f1-99ff-68a47be2e63a tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:16.717762 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-c329b436-14a3-41f1-99ff-68a47be2e63a tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:16.748147 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c329b436-14a3-41f1-99ff-68a47be2e63a tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:16.749073 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c329b436-14a3-41f1-99ff-68a47be2e63a tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:16.750057 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c329b436-14a3-41f1-99ff-68a47be2e63a tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:16.751318 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c329b436-14a3-41f1-99ff-68a47be2e63a tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:16.795008 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-cb5780ec-f60b-4811-8b27-666f8ac26b52 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action" status: 200 len: 28263 microversion: 2.20 time: 0.121543 Nov 16 16:05:16.796264 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 116/226] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:05:16 2021] POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action => generated 28263 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:05:16.877660 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-c329b436-14a3-41f1-99ff-68a47be2e63a tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action" status: 200 len: 27790 microversion: 2.1 time: 0.169466 Nov 16 16:05:16.879173 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 111/227] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:05:16 2021] POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action => generated 27790 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:05:16.941531 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-dbadbd8b-eac6-42ce-8d58-637a37ae1b57 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:16.942633 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-dbadbd8b-eac6-42ce-8d58-637a37ae1b57 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:16.951395 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dbadbd8b-eac6-42ce-8d58-637a37ae1b57 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:16.951995 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dbadbd8b-eac6-42ce-8d58-637a37ae1b57 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:16.953057 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dbadbd8b-eac6-42ce-8d58-637a37ae1b57 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:16.953717 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dbadbd8b-eac6-42ce-8d58-637a37ae1b57 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:17.176649 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-dbadbd8b-eac6-42ce-8d58-637a37ae1b57 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:17.186172 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-dbadbd8b-eac6-42ce-8d58-637a37ae1b57 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248" status: 200 len: 1522 microversion: 2.1 time: 0.249866 Nov 16 16:05:17.201524 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 117/228] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:16 2021] GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248 => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:05:17.808747 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-85767b41-9767-47ba-a286-604eaf7f0eb4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:17.809920 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-85767b41-9767-47ba-a286-604eaf7f0eb4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:17.824867 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-85767b41-9767-47ba-a286-604eaf7f0eb4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:17.828396 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-85767b41-9767-47ba-a286-604eaf7f0eb4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:17.829285 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-85767b41-9767-47ba-a286-604eaf7f0eb4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:17.829728 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-85767b41-9767-47ba-a286-604eaf7f0eb4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:17.893844 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3935795d-1a83-47a2-839a-bd3ad7eddd58 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:17.894811 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-3935795d-1a83-47a2-839a-bd3ad7eddd58 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:17.903094 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3935795d-1a83-47a2-839a-bd3ad7eddd58 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:17.903578 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3935795d-1a83-47a2-839a-bd3ad7eddd58 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:17.907828 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3935795d-1a83-47a2-839a-bd3ad7eddd58 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:17.908301 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3935795d-1a83-47a2-839a-bd3ad7eddd58 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:17.932809 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-85767b41-9767-47ba-a286-604eaf7f0eb4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action" status: 200 len: 28263 microversion: 2.20 time: 0.129058 Nov 16 16:05:17.933705 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 112/229] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:05:17 2021] POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action => generated 28263 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:05:18.034239 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-3935795d-1a83-47a2-839a-bd3ad7eddd58 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action" status: 200 len: 28020 microversion: 2.1 time: 0.146264 Nov 16 16:05:18.038131 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 118/230] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:05:17 2021] POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action => generated 28020 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:05:18.208377 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-5455c530-6852-49e9-8454-ca230fee0d2d tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:18.209937 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-5455c530-6852-49e9-8454-ca230fee0d2d tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:18.218869 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5455c530-6852-49e9-8454-ca230fee0d2d tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:18.219599 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5455c530-6852-49e9-8454-ca230fee0d2d tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:18.220601 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5455c530-6852-49e9-8454-ca230fee0d2d tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:18.221551 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5455c530-6852-49e9-8454-ca230fee0d2d tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:18.397879 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-5455c530-6852-49e9-8454-ca230fee0d2d tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:18.408823 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-5455c530-6852-49e9-8454-ca230fee0d2d tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248" status: 200 len: 1522 microversion: 2.1 time: 0.205731 Nov 16 16:05:18.409512 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 113/231] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:18 2021] GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:05:18.945701 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-4ff19bd2-7419-4ac0-bed8-4df78a9c6449 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:18.946721 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-4ff19bd2-7419-4ac0-bed8-4df78a9c6449 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:18.954309 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4ff19bd2-7419-4ac0-bed8-4df78a9c6449 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:18.955101 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4ff19bd2-7419-4ac0-bed8-4df78a9c6449 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:18.956354 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4ff19bd2-7419-4ac0-bed8-4df78a9c6449 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:18.956786 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4ff19bd2-7419-4ac0-bed8-4df78a9c6449 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:19.046153 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-7bf3d17d-eb30-4df5-a49e-491ed58872f4 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:19.047217 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-7bf3d17d-eb30-4df5-a49e-491ed58872f4 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:19.054409 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7bf3d17d-eb30-4df5-a49e-491ed58872f4 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:19.055033 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7bf3d17d-eb30-4df5-a49e-491ed58872f4 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:19.055847 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7bf3d17d-eb30-4df5-a49e-491ed58872f4 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:19.056711 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7bf3d17d-eb30-4df5-a49e-491ed58872f4 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:21.166101 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-4ff19bd2-7419-4ac0-bed8-4df78a9c6449 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action" status: 200 len: 28263 microversion: 2.20 time: 2.224189 Nov 16 16:05:21.169768 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 119/232] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:05:18 2021] POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action => generated 28263 bytes in 2226 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:05:21.171683 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7a55721c-86ac-418f-af39-e19c3afbb7a5 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:21.172792 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-7a55721c-86ac-418f-af39-e19c3afbb7a5 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:21.180633 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7a55721c-86ac-418f-af39-e19c3afbb7a5 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:21.181358 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7a55721c-86ac-418f-af39-e19c3afbb7a5 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:21.182062 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7a55721c-86ac-418f-af39-e19c3afbb7a5 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:21.182906 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7a55721c-86ac-418f-af39-e19c3afbb7a5 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:21.192699 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-7bf3d17d-eb30-4df5-a49e-491ed58872f4 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action" status: 200 len: 28209 microversion: 2.1 time: 2.150290 Nov 16 16:05:21.197066 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 114/233] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:05:19 2021] POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action => generated 28209 bytes in 2153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 16:05:21.348105 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7a55721c-86ac-418f-af39-e19c3afbb7a5 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:21.355398 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-7a55721c-86ac-418f-af39-e19c3afbb7a5 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248" status: 200 len: 1522 microversion: 2.1 time: 0.187481 Nov 16 16:05:21.356005 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 120/234] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:21 2021] GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:05:22.178453 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-2d181da8-9cab-4940-9636-97cb462ee677 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:22.179454 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-2d181da8-9cab-4940-9636-97cb462ee677 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:22.186612 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2d181da8-9cab-4940-9636-97cb462ee677 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:22.187094 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2d181da8-9cab-4940-9636-97cb462ee677 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:22.188746 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2d181da8-9cab-4940-9636-97cb462ee677 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:22.188746 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2d181da8-9cab-4940-9636-97cb462ee677 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:22.204889 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-89caf586-6b29-4065-a940-db4010b46d7b tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:22.205926 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-89caf586-6b29-4065-a940-db4010b46d7b tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:22.217108 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-89caf586-6b29-4065-a940-db4010b46d7b tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:22.217607 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-89caf586-6b29-4065-a940-db4010b46d7b tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:22.218511 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-89caf586-6b29-4065-a940-db4010b46d7b tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:22.218993 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-89caf586-6b29-4065-a940-db4010b46d7b tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:22.298957 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-2d181da8-9cab-4940-9636-97cb462ee677 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action" status: 200 len: 28263 microversion: 2.20 time: 0.124216 Nov 16 16:05:22.299872 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 115/235] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:05:22 2021] POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action => generated 28263 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:05:22.312108 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-89caf586-6b29-4065-a940-db4010b46d7b tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action" status: 200 len: 28209 microversion: 2.1 time: 0.111158 Nov 16 16:05:22.312833 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 121/236] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:05:22 2021] POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action => generated 28209 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 16:05:22.373047 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-083f8ea0-bf92-43a2-be87-fae2429449d6 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:22.373894 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-083f8ea0-bf92-43a2-be87-fae2429449d6 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:22.381702 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-083f8ea0-bf92-43a2-be87-fae2429449d6 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:22.382139 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-083f8ea0-bf92-43a2-be87-fae2429449d6 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:22.382921 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-083f8ea0-bf92-43a2-be87-fae2429449d6 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:22.383381 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-083f8ea0-bf92-43a2-be87-fae2429449d6 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:22.520127 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-083f8ea0-bf92-43a2-be87-fae2429449d6 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:22.528381 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-083f8ea0-bf92-43a2-be87-fae2429449d6 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248" status: 200 len: 1522 microversion: 2.1 time: 0.159351 Nov 16 16:05:22.528981 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 116/237] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:22 2021] GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:05:23.314684 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-69638464-2902-4d03-b219-26f3f1a4cf09 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:23.319485 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-69638464-2902-4d03-b219-26f3f1a4cf09 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:23.325045 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-9476be43-f6dc-4012-b3ed-1a600977bca9 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:23.326136 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-9476be43-f6dc-4012-b3ed-1a600977bca9 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:23.332810 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9476be43-f6dc-4012-b3ed-1a600977bca9 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:23.333258 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9476be43-f6dc-4012-b3ed-1a600977bca9 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:23.334035 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9476be43-f6dc-4012-b3ed-1a600977bca9 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:23.334463 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9476be43-f6dc-4012-b3ed-1a600977bca9 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:23.342520 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-69638464-2902-4d03-b219-26f3f1a4cf09 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:23.343207 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-69638464-2902-4d03-b219-26f3f1a4cf09 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:23.344102 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-69638464-2902-4d03-b219-26f3f1a4cf09 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:23.345290 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-69638464-2902-4d03-b219-26f3f1a4cf09 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:26.372053 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-9476be43-f6dc-4012-b3ed-1a600977bca9 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action" status: 200 len: 28209 microversion: 2.1 time: 3.050943 Nov 16 16:05:26.373171 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 117/238] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:05:23 2021] POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action => generated 28209 bytes in 3053 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:05:26.378526 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-c0dca952-3c86-4924-97cd-a4fd8592fffa tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:26.379307 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-c0dca952-3c86-4924-97cd-a4fd8592fffa tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:26.386279 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c0dca952-3c86-4924-97cd-a4fd8592fffa tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:26.386729 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c0dca952-3c86-4924-97cd-a4fd8592fffa tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:26.387530 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c0dca952-3c86-4924-97cd-a4fd8592fffa tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:26.387972 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c0dca952-3c86-4924-97cd-a4fd8592fffa tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:26.427606 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-69638464-2902-4d03-b219-26f3f1a4cf09 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action" status: 200 len: 28553 microversion: 2.20 time: 3.117272 Nov 16 16:05:26.428931 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 122/239] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:05:23 2021] POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action => generated 28553 bytes in 3119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:05:26.529184 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-c0dca952-3c86-4924-97cd-a4fd8592fffa tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:26.536477 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-c0dca952-3c86-4924-97cd-a4fd8592fffa tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248" status: 200 len: 1522 microversion: 2.1 time: 0.162122 Nov 16 16:05:26.537045 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 118/240] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:26 2021] GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:05:27.384289 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-dd7991c0-da73-49ca-8b73-e860a7fd6eb5 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:27.385409 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-dd7991c0-da73-49ca-8b73-e860a7fd6eb5 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:27.393490 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dd7991c0-da73-49ca-8b73-e860a7fd6eb5 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:27.393943 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dd7991c0-da73-49ca-8b73-e860a7fd6eb5 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:27.394725 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dd7991c0-da73-49ca-8b73-e860a7fd6eb5 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:27.395270 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dd7991c0-da73-49ca-8b73-e860a7fd6eb5 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:27.438449 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-45e5639d-1169-453b-8068-cdfe3a42bd36 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:27.440348 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-45e5639d-1169-453b-8068-cdfe3a42bd36 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:27.446626 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-45e5639d-1169-453b-8068-cdfe3a42bd36 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:27.447077 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-45e5639d-1169-453b-8068-cdfe3a42bd36 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:27.447958 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-45e5639d-1169-453b-8068-cdfe3a42bd36 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:27.448320 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-45e5639d-1169-453b-8068-cdfe3a42bd36 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:27.482327 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-dd7991c0-da73-49ca-8b73-e860a7fd6eb5 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action" status: 200 len: 28209 microversion: 2.1 time: 0.101813 Nov 16 16:05:27.488996 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 123/241] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:05:27 2021] POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action => generated 28209 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:05:27.518949 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-45e5639d-1169-453b-8068-cdfe3a42bd36 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action" status: 200 len: 28553 microversion: 2.20 time: 0.084503 Nov 16 16:05:27.519659 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 119/242] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:05:27 2021] POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action => generated 28553 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:05:27.555614 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-831be3b5-9b91-4e8a-881b-db10aa070793 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:27.556308 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-831be3b5-9b91-4e8a-881b-db10aa070793 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:27.563074 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-831be3b5-9b91-4e8a-881b-db10aa070793 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:27.564085 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-831be3b5-9b91-4e8a-881b-db10aa070793 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:27.565122 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-831be3b5-9b91-4e8a-881b-db10aa070793 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:27.565656 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-831be3b5-9b91-4e8a-881b-db10aa070793 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:27.756152 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-831be3b5-9b91-4e8a-881b-db10aa070793 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:27.763917 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-831be3b5-9b91-4e8a-881b-db10aa070793 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248" status: 200 len: 1502 microversion: 2.1 time: 0.212201 Nov 16 16:05:27.764482 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 124/243] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:27 2021] GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248 => generated 1502 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:05:27.780890 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-9bbbd023-64d5-4e78-8232-229e09a34bf6 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:27.781812 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-9bbbd023-64d5-4e78-8232-229e09a34bf6 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:27.789086 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9bbbd023-64d5-4e78-8232-229e09a34bf6 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:27.789535 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9bbbd023-64d5-4e78-8232-229e09a34bf6 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:27.790304 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9bbbd023-64d5-4e78-8232-229e09a34bf6 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:27.790729 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9bbbd023-64d5-4e78-8232-229e09a34bf6 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:27.945374 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-9bbbd023-64d5-4e78-8232-229e09a34bf6 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:27.958619 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-9bbbd023-64d5-4e78-8232-229e09a34bf6 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1516 microversion: 2.1 time: 0.181907 Nov 16 16:05:27.961351 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 120/244] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:27 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1516 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:05:28.493993 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b39ea4c9-9dd3-459d-8304-116b6cad6673 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:28.495580 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b39ea4c9-9dd3-459d-8304-116b6cad6673 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:28.502694 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b39ea4c9-9dd3-459d-8304-116b6cad6673 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:28.503519 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b39ea4c9-9dd3-459d-8304-116b6cad6673 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:28.504634 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b39ea4c9-9dd3-459d-8304-116b6cad6673 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:28.505079 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b39ea4c9-9dd3-459d-8304-116b6cad6673 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:28.539930 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-bf7b0f2a-8e19-4894-a7c6-22e8dd12edda tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:28.540995 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-bf7b0f2a-8e19-4894-a7c6-22e8dd12edda tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:28.548255 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bf7b0f2a-8e19-4894-a7c6-22e8dd12edda tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:28.548912 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bf7b0f2a-8e19-4894-a7c6-22e8dd12edda tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:28.549983 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bf7b0f2a-8e19-4894-a7c6-22e8dd12edda tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:28.550623 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bf7b0f2a-8e19-4894-a7c6-22e8dd12edda tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:28.601515 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b39ea4c9-9dd3-459d-8304-116b6cad6673 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action" status: 200 len: 28498 microversion: 2.1 time: 0.110952 Nov 16 16:05:28.605626 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 125/245] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:05:28 2021] POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action => generated 28498 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:05:28.659501 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-bf7b0f2a-8e19-4894-a7c6-22e8dd12edda tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action" status: 200 len: 28719 microversion: 2.20 time: 0.129963 Nov 16 16:05:28.661073 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 121/246] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:05:28 2021] POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action => generated 28719 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:05:29.451546 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e132714e-78f3-4a8e-8e9d-880245115e90 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:29.452792 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e132714e-78f3-4a8e-8e9d-880245115e90 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:29.460582 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e132714e-78f3-4a8e-8e9d-880245115e90 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:29.460951 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e132714e-78f3-4a8e-8e9d-880245115e90 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:29.461731 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e132714e-78f3-4a8e-8e9d-880245115e90 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:29.462163 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e132714e-78f3-4a8e-8e9d-880245115e90 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:29.491623 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.objects.instance [None req-e132714e-78f3-4a8e-8e9d-880245115e90 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lazy-loading 'flavor' on Instance uuid 69df60e2-42c9-4caa-abdc-a7ecb61d8d73 {{(pid=116084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:05:29.604846 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e132714e-78f3-4a8e-8e9d-880245115e90 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "POST /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73/action" status: 200 len: 32 microversion: 2.1 time: 0.157657 Nov 16 16:05:29.605500 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 126/247] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:05:29 2021] POST /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73/action => generated 32 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 16:05:29.615371 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-e3b574e8-36d8-4e83-9fae-4a810e03480c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:29.617213 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-e3b574e8-36d8-4e83-9fae-4a810e03480c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:29.617848 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-758cdb92-7493-462d-b3ba-449ad1298fa5 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:29.619438 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-758cdb92-7493-462d-b3ba-449ad1298fa5 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:29.631411 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-758cdb92-7493-462d-b3ba-449ad1298fa5 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:29.632534 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-758cdb92-7493-462d-b3ba-449ad1298fa5 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:29.635066 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-758cdb92-7493-462d-b3ba-449ad1298fa5 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:29.636255 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-758cdb92-7493-462d-b3ba-449ad1298fa5 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:29.661513 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e3b574e8-36d8-4e83-9fae-4a810e03480c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:29.663551 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e3b574e8-36d8-4e83-9fae-4a810e03480c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:29.664596 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e3b574e8-36d8-4e83-9fae-4a810e03480c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:29.666679 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e3b574e8-36d8-4e83-9fae-4a810e03480c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:29.769386 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-e3b574e8-36d8-4e83-9fae-4a810e03480c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action" status: 200 len: 28666 microversion: 2.1 time: 0.159574 Nov 16 16:05:29.770315 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 122/248] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:05:29 2021] POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action => generated 28666 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:05:29.778147 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-026d6ca5-a2e9-467d-adc5-be4e06fff6da tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:29.780417 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-026d6ca5-a2e9-467d-adc5-be4e06fff6da tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:29.804847 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-026d6ca5-a2e9-467d-adc5-be4e06fff6da tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:29.805303 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-026d6ca5-a2e9-467d-adc5-be4e06fff6da tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:29.806101 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-026d6ca5-a2e9-467d-adc5-be4e06fff6da tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:29.806706 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-026d6ca5-a2e9-467d-adc5-be4e06fff6da tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:29.827853 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-758cdb92-7493-462d-b3ba-449ad1298fa5 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:29.839088 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-758cdb92-7493-462d-b3ba-449ad1298fa5 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1522 microversion: 2.1 time: 0.225901 Nov 16 16:05:29.845165 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 127/249] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:29 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:05:29.901297 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-026d6ca5-a2e9-467d-adc5-be4e06fff6da tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action" status: 200 len: 28719 microversion: 2.20 time: 0.129327 Nov 16 16:05:29.902098 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 123/250] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:05:29 2021] POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action => generated 28719 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:05:30.781199 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d0825338-d22f-451b-a1f4-de3a1788415d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:30.782260 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d0825338-d22f-451b-a1f4-de3a1788415d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:30.792032 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d0825338-d22f-451b-a1f4-de3a1788415d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:30.792032 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d0825338-d22f-451b-a1f4-de3a1788415d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:30.792032 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d0825338-d22f-451b-a1f4-de3a1788415d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:30.792032 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d0825338-d22f-451b-a1f4-de3a1788415d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:30.854078 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d0825338-d22f-451b-a1f4-de3a1788415d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action" status: 200 len: 28666 microversion: 2.1 time: 0.076570 Nov 16 16:05:30.858667 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 128/251] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:05:30 2021] POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action => generated 28666 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 16:05:30.858821 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-a79de91b-6015-4317-b0c8-1c8df3cc987e tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:30.858821 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-a79de91b-6015-4317-b0c8-1c8df3cc987e tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:30.876145 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a79de91b-6015-4317-b0c8-1c8df3cc987e tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:30.876972 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a79de91b-6015-4317-b0c8-1c8df3cc987e tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:30.877484 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a79de91b-6015-4317-b0c8-1c8df3cc987e tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:30.877922 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a79de91b-6015-4317-b0c8-1c8df3cc987e tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:30.935117 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-84092fc2-990b-4a99-808a-272f3e8b3720 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:30.942590 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-84092fc2-990b-4a99-808a-272f3e8b3720 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:30.959835 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-84092fc2-990b-4a99-808a-272f3e8b3720 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:30.964859 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-84092fc2-990b-4a99-808a-272f3e8b3720 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:30.965810 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-84092fc2-990b-4a99-808a-272f3e8b3720 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:30.967348 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-84092fc2-990b-4a99-808a-272f3e8b3720 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:31.053781 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-84092fc2-990b-4a99-808a-272f3e8b3720 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action" status: 200 len: 28719 microversion: 2.20 time: 0.142724 Nov 16 16:05:31.059532 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 129/252] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:05:30 2021] POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action => generated 28719 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:05:31.163416 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-a79de91b-6015-4317-b0c8-1c8df3cc987e tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:31.173771 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-a79de91b-6015-4317-b0c8-1c8df3cc987e tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1522 microversion: 2.1 time: 0.319943 Nov 16 16:05:31.175221 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 124/253] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:30 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1522 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:05:31.872421 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d09cfeda-f22a-494c-8bd2-d208fc54ba8f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:31.874415 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d09cfeda-f22a-494c-8bd2-d208fc54ba8f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:31.884567 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d09cfeda-f22a-494c-8bd2-d208fc54ba8f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:31.885387 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d09cfeda-f22a-494c-8bd2-d208fc54ba8f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:31.886457 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d09cfeda-f22a-494c-8bd2-d208fc54ba8f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:31.890741 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d09cfeda-f22a-494c-8bd2-d208fc54ba8f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:31.982174 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d09cfeda-f22a-494c-8bd2-d208fc54ba8f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action" status: 200 len: 28666 microversion: 2.1 time: 0.117172 Nov 16 16:05:31.983407 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 130/254] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:05:31 2021] POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action => generated 28666 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:05:32.067193 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-c1c9ba81-960c-4850-bfed-785e1b0a49ce tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:32.067601 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-c1c9ba81-960c-4850-bfed-785e1b0a49ce tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:32.073867 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c1c9ba81-960c-4850-bfed-785e1b0a49ce tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:32.074603 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c1c9ba81-960c-4850-bfed-785e1b0a49ce tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:32.075609 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c1c9ba81-960c-4850-bfed-785e1b0a49ce tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:32.076242 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c1c9ba81-960c-4850-bfed-785e1b0a49ce tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:32.174882 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-c1c9ba81-960c-4850-bfed-785e1b0a49ce tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action" status: 200 len: 28719 microversion: 2.20 time: 0.103590 Nov 16 16:05:32.175667 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 125/255] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:05:32 2021] POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action => generated 28719 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:05:32.192960 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3e5f0245-7275-447b-82b5-d90cc004ac7f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:32.194076 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-3e5f0245-7275-447b-82b5-d90cc004ac7f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:32.205476 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3e5f0245-7275-447b-82b5-d90cc004ac7f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:32.206118 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3e5f0245-7275-447b-82b5-d90cc004ac7f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:32.207153 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3e5f0245-7275-447b-82b5-d90cc004ac7f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:32.207779 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3e5f0245-7275-447b-82b5-d90cc004ac7f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:32.390857 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-3e5f0245-7275-447b-82b5-d90cc004ac7f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:32.399021 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-3e5f0245-7275-447b-82b5-d90cc004ac7f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1522 microversion: 2.1 time: 0.211306 Nov 16 16:05:32.400955 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 131/256] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:32 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:05:32.994583 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-91bad74f-2bc8-4678-a339-8d17558acba8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:32.995690 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-91bad74f-2bc8-4678-a339-8d17558acba8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:33.004219 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-91bad74f-2bc8-4678-a339-8d17558acba8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:33.004849 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-91bad74f-2bc8-4678-a339-8d17558acba8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:33.005949 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-91bad74f-2bc8-4678-a339-8d17558acba8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:33.006525 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-91bad74f-2bc8-4678-a339-8d17558acba8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:33.089977 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-91bad74f-2bc8-4678-a339-8d17558acba8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action" status: 200 len: 28666 microversion: 2.1 time: 0.099073 Nov 16 16:05:33.091539 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 126/257] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:05:32 2021] POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action => generated 28666 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:05:33.188469 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-87bbfd73-c42e-4216-8723-84067563db74 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:33.190982 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-87bbfd73-c42e-4216-8723-84067563db74 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:33.200744 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-87bbfd73-c42e-4216-8723-84067563db74 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:33.201306 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-87bbfd73-c42e-4216-8723-84067563db74 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:33.204178 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-87bbfd73-c42e-4216-8723-84067563db74 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:33.204804 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-87bbfd73-c42e-4216-8723-84067563db74 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:33.310361 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-87bbfd73-c42e-4216-8723-84067563db74 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action" status: 200 len: 28719 microversion: 2.20 time: 0.127102 Nov 16 16:05:33.311114 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 132/258] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:05:33 2021] POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action => generated 28719 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:05:33.421129 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-593e0061-cc45-4060-8bb7-84df0a6225f0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:33.422195 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-593e0061-cc45-4060-8bb7-84df0a6225f0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:33.434599 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-593e0061-cc45-4060-8bb7-84df0a6225f0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:33.436382 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-593e0061-cc45-4060-8bb7-84df0a6225f0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:33.438269 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-593e0061-cc45-4060-8bb7-84df0a6225f0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:33.440899 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-593e0061-cc45-4060-8bb7-84df0a6225f0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:33.697244 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-593e0061-cc45-4060-8bb7-84df0a6225f0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:33.710819 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-593e0061-cc45-4060-8bb7-84df0a6225f0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1522 microversion: 2.1 time: 0.293769 Nov 16 16:05:33.711480 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 127/259] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:33 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1522 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:05:34.104849 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a3950d06-ec19-46fb-995b-351caca977d9 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:34.106114 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-a3950d06-ec19-46fb-995b-351caca977d9 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:34.116076 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a3950d06-ec19-46fb-995b-351caca977d9 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:34.116698 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a3950d06-ec19-46fb-995b-351caca977d9 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:34.124221 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a3950d06-ec19-46fb-995b-351caca977d9 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:34.124958 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a3950d06-ec19-46fb-995b-351caca977d9 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:34.229478 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-a3950d06-ec19-46fb-995b-351caca977d9 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action" status: 200 len: 28666 microversion: 2.1 time: 0.128580 Nov 16 16:05:34.231534 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 133/260] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:05:34 2021] POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action => generated 28666 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:05:34.324817 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-2e372e94-8e73-4e69-9deb-c085ae939f4e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:34.325835 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-2e372e94-8e73-4e69-9deb-c085ae939f4e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:34.332722 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2e372e94-8e73-4e69-9deb-c085ae939f4e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:34.333266 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2e372e94-8e73-4e69-9deb-c085ae939f4e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:34.334283 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2e372e94-8e73-4e69-9deb-c085ae939f4e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:34.334815 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2e372e94-8e73-4e69-9deb-c085ae939f4e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:34.446623 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-2e372e94-8e73-4e69-9deb-c085ae939f4e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action" status: 200 len: 29145 microversion: 2.20 time: 0.125055 Nov 16 16:05:34.447579 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 128/261] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:05:34 2021] POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action => generated 29145 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:05:34.750910 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c8a44d26-874f-49af-9fa4-ffa18211673a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:34.751722 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c8a44d26-874f-49af-9fa4-ffa18211673a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:34.763635 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c8a44d26-874f-49af-9fa4-ffa18211673a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:34.764299 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c8a44d26-874f-49af-9fa4-ffa18211673a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:34.765288 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c8a44d26-874f-49af-9fa4-ffa18211673a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:34.765735 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c8a44d26-874f-49af-9fa4-ffa18211673a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:35.008571 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-c8a44d26-874f-49af-9fa4-ffa18211673a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:35.018682 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c8a44d26-874f-49af-9fa4-ffa18211673a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1522 microversion: 2.1 time: 0.276962 Nov 16 16:05:35.027645 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 134/262] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:34 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:05:35.253659 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-54ea453e-4f8c-4b34-8f53-70bafd805c58 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:35.261269 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-54ea453e-4f8c-4b34-8f53-70bafd805c58 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:35.270708 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-54ea453e-4f8c-4b34-8f53-70bafd805c58 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:35.271381 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-54ea453e-4f8c-4b34-8f53-70bafd805c58 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:35.272449 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-54ea453e-4f8c-4b34-8f53-70bafd805c58 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:35.273032 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-54ea453e-4f8c-4b34-8f53-70bafd805c58 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:35.369975 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-54ea453e-4f8c-4b34-8f53-70bafd805c58 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action" status: 200 len: 28666 microversion: 2.1 time: 0.130935 Nov 16 16:05:35.371776 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 129/263] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:05:35 2021] POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action => generated 28666 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:05:35.459330 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b54a74e1-61b2-4dd6-9603-71ff4e6b86a6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:35.460476 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b54a74e1-61b2-4dd6-9603-71ff4e6b86a6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:35.467108 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b54a74e1-61b2-4dd6-9603-71ff4e6b86a6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:35.467690 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b54a74e1-61b2-4dd6-9603-71ff4e6b86a6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:35.468477 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b54a74e1-61b2-4dd6-9603-71ff4e6b86a6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:35.468916 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b54a74e1-61b2-4dd6-9603-71ff4e6b86a6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:35.557560 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b54a74e1-61b2-4dd6-9603-71ff4e6b86a6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action" status: 200 len: 30091 microversion: 2.20 time: 0.102815 Nov 16 16:05:35.558259 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 135/264] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:05:35 2021] POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action => generated 30091 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 16 16:05:36.038230 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-bc070ee5-1ced-4fd9-a7db-4f3176e92f8b tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:36.038938 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-bc070ee5-1ced-4fd9-a7db-4f3176e92f8b tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:36.046145 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bc070ee5-1ced-4fd9-a7db-4f3176e92f8b tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:36.046581 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bc070ee5-1ced-4fd9-a7db-4f3176e92f8b tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:36.047361 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bc070ee5-1ced-4fd9-a7db-4f3176e92f8b tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:36.047812 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bc070ee5-1ced-4fd9-a7db-4f3176e92f8b tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:36.200015 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-bc070ee5-1ced-4fd9-a7db-4f3176e92f8b tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:36.208562 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-bc070ee5-1ced-4fd9-a7db-4f3176e92f8b tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1522 microversion: 2.1 time: 0.175598 Nov 16 16:05:36.209180 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 130/265] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:36 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:05:36.383023 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-574a231c-3484-44bd-8943-c7666d08b7b7 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:36.384209 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-574a231c-3484-44bd-8943-c7666d08b7b7 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:36.390905 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-574a231c-3484-44bd-8943-c7666d08b7b7 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:36.391351 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-574a231c-3484-44bd-8943-c7666d08b7b7 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:36.392851 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-574a231c-3484-44bd-8943-c7666d08b7b7 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:36.393631 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-574a231c-3484-44bd-8943-c7666d08b7b7 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:36.475996 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-574a231c-3484-44bd-8943-c7666d08b7b7 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action" status: 200 len: 28666 microversion: 2.1 time: 0.096755 Nov 16 16:05:36.477357 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 136/266] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:05:36 2021] POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action => generated 28666 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:05:36.526860 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-c36f2955-249e-419e-9826-fee8f1149b33 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-899908442", "imageRef": "7c3bd8e0-8d7e-4cf7-90db-742c4f55e405", "flavorRef": "452", "networks": [{"uuid": "3ab3dac8-cc77-4d96-958c-ff31e1be9045"}]}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:36.570399 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e393027d-5333-4bec-9fe9-3144824d078d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:36.571401 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e393027d-5333-4bec-9fe9-3144824d078d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:36.578304 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e393027d-5333-4bec-9fe9-3144824d078d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:36.578756 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e393027d-5333-4bec-9fe9-3144824d078d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:36.580200 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e393027d-5333-4bec-9fe9-3144824d078d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:36.580648 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e393027d-5333-4bec-9fe9-3144824d078d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:36.660322 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e393027d-5333-4bec-9fe9-3144824d078d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action" status: 200 len: 30905 microversion: 2.20 time: 0.093824 Nov 16 16:05:36.660990 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 137/267] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:05:36 2021] POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action => generated 30905 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 16 16:05:37.226845 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1621fe11-24e2-456d-920c-bee14958e90c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:37.227566 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1621fe11-24e2-456d-920c-bee14958e90c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:37.234323 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1621fe11-24e2-456d-920c-bee14958e90c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:37.234774 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1621fe11-24e2-456d-920c-bee14958e90c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:37.235572 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1621fe11-24e2-456d-920c-bee14958e90c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:37.236637 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1621fe11-24e2-456d-920c-bee14958e90c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:37.367480 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1621fe11-24e2-456d-920c-bee14958e90c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:37.375255 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1621fe11-24e2-456d-920c-bee14958e90c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1522 microversion: 2.1 time: 0.152436 Nov 16 16:05:37.375847 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 138/268] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:37 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:05:37.530194 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0625e702-133f-4b8b-8512-45cd343d00e0 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:37.531110 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0625e702-133f-4b8b-8512-45cd343d00e0 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:37.538022 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0625e702-133f-4b8b-8512-45cd343d00e0 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:37.538474 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0625e702-133f-4b8b-8512-45cd343d00e0 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:37.539255 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0625e702-133f-4b8b-8512-45cd343d00e0 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:37.539712 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0625e702-133f-4b8b-8512-45cd343d00e0 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:37.622724 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0625e702-133f-4b8b-8512-45cd343d00e0 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action" status: 200 len: 29032 microversion: 2.1 time: 0.096292 Nov 16 16:05:37.623376 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 139/269] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:05:37 2021] POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action => generated 29032 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 16:05:37.672182 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-48c1a4bb-d283-41ed-8472-17584419dbe0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:37.673183 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-48c1a4bb-d283-41ed-8472-17584419dbe0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:37.680175 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-48c1a4bb-d283-41ed-8472-17584419dbe0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:37.680622 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-48c1a4bb-d283-41ed-8472-17584419dbe0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:37.681419 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-48c1a4bb-d283-41ed-8472-17584419dbe0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:37.681837 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-48c1a4bb-d283-41ed-8472-17584419dbe0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:37.772641 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-48c1a4bb-d283-41ed-8472-17584419dbe0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action" status: 200 len: 31860 microversion: 2.20 time: 0.104131 Nov 16 16:05:37.773320 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 140/270] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:05:37 2021] POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action => generated 31860 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:05:38.393899 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3c95c339-5489-4861-a1e5-052abf99fe61 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:38.395082 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-3c95c339-5489-4861-a1e5-052abf99fe61 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:38.402828 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3c95c339-5489-4861-a1e5-052abf99fe61 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:38.403409 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3c95c339-5489-4861-a1e5-052abf99fe61 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:38.404420 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3c95c339-5489-4861-a1e5-052abf99fe61 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:38.404845 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3c95c339-5489-4861-a1e5-052abf99fe61 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:38.541519 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-3c95c339-5489-4861-a1e5-052abf99fe61 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:38.549887 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-3c95c339-5489-4861-a1e5-052abf99fe61 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1522 microversion: 2.1 time: 0.160738 Nov 16 16:05:38.550454 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 141/271] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:38 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:05:38.635023 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-65aea7c0-9f92-4e2a-a606-f3201176041f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:38.635985 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-65aea7c0-9f92-4e2a-a606-f3201176041f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:38.642061 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-65aea7c0-9f92-4e2a-a606-f3201176041f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:38.642511 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-65aea7c0-9f92-4e2a-a606-f3201176041f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:38.643294 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-65aea7c0-9f92-4e2a-a606-f3201176041f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:38.643751 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-65aea7c0-9f92-4e2a-a606-f3201176041f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:38.739784 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-65aea7c0-9f92-4e2a-a606-f3201176041f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action" status: 200 len: 30331 microversion: 2.1 time: 0.109365 Nov 16 16:05:38.743781 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 142/272] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:05:38 2021] POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action => generated 30331 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 16:05:38.821435 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-055f8410-79e3-4107-acce-f377a9630407 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:38.822466 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-055f8410-79e3-4107-acce-f377a9630407 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:38.829214 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-055f8410-79e3-4107-acce-f377a9630407 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:38.829662 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-055f8410-79e3-4107-acce-f377a9630407 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:38.830440 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-055f8410-79e3-4107-acce-f377a9630407 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:38.830868 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-055f8410-79e3-4107-acce-f377a9630407 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:38.909939 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-055f8410-79e3-4107-acce-f377a9630407 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action" status: 200 len: 32571 microversion: 2.20 time: 0.092359 Nov 16 16:05:38.910622 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 143/273] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:05:38 2021] POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action => generated 32571 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 16 16:05:39.567626 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-4ef82268-31ea-4ee7-8a15-657db76d8a1d tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:39.568323 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-4ef82268-31ea-4ee7-8a15-657db76d8a1d tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:39.575158 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4ef82268-31ea-4ee7-8a15-657db76d8a1d tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:39.575650 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4ef82268-31ea-4ee7-8a15-657db76d8a1d tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:39.576430 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4ef82268-31ea-4ee7-8a15-657db76d8a1d tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:39.576867 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4ef82268-31ea-4ee7-8a15-657db76d8a1d tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:39.741349 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-4ef82268-31ea-4ee7-8a15-657db76d8a1d tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:39.748963 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-4ef82268-31ea-4ee7-8a15-657db76d8a1d tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1522 microversion: 2.1 time: 0.185955 Nov 16 16:05:39.749539 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 144/274] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:39 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:05:39.754779 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-06973522-64b5-483b-bf14-7d1e0e09dac4 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:39.755715 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-06973522-64b5-483b-bf14-7d1e0e09dac4 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:39.761781 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-06973522-64b5-483b-bf14-7d1e0e09dac4 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:39.762701 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-06973522-64b5-483b-bf14-7d1e0e09dac4 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:39.763739 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-06973522-64b5-483b-bf14-7d1e0e09dac4 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:39.764480 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-06973522-64b5-483b-bf14-7d1e0e09dac4 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:39.850534 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-06973522-64b5-483b-bf14-7d1e0e09dac4 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action" status: 200 len: 31744 microversion: 2.1 time: 0.099617 Nov 16 16:05:39.853698 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 145/275] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:05:39 2021] POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action => generated 31744 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:05:39.922186 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-520f9a2e-dc45-4bfe-ba48-a2bf399f52c9 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:39.923841 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-520f9a2e-dc45-4bfe-ba48-a2bf399f52c9 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:39.930893 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-520f9a2e-dc45-4bfe-ba48-a2bf399f52c9 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:39.931349 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-520f9a2e-dc45-4bfe-ba48-a2bf399f52c9 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:39.932164 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-520f9a2e-dc45-4bfe-ba48-a2bf399f52c9 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:39.932604 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-520f9a2e-dc45-4bfe-ba48-a2bf399f52c9 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:40.021108 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-520f9a2e-dc45-4bfe-ba48-a2bf399f52c9 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action" status: 200 len: 33301 microversion: 2.20 time: 0.102753 Nov 16 16:05:40.022020 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 146/276] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:05:39 2021] POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action => generated 33301 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 16 16:05:40.769402 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6890dd30-8e08-4431-9f1b-e5d80ae0f346 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:40.771104 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-6890dd30-8e08-4431-9f1b-e5d80ae0f346 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:40.776657 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6890dd30-8e08-4431-9f1b-e5d80ae0f346 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:40.777116 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6890dd30-8e08-4431-9f1b-e5d80ae0f346 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:40.778187 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6890dd30-8e08-4431-9f1b-e5d80ae0f346 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:40.778697 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6890dd30-8e08-4431-9f1b-e5d80ae0f346 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:40.920667 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-6890dd30-8e08-4431-9f1b-e5d80ae0f346 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:40.930411 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-6890dd30-8e08-4431-9f1b-e5d80ae0f346 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1522 microversion: 2.1 time: 0.166567 Nov 16 16:05:40.931112 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 147/277] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:40 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:05:40.938187 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d087aed8-6178-4cb7-b41f-4551235bd5d7 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:40.940216 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d087aed8-6178-4cb7-b41f-4551235bd5d7 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:40.947611 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d087aed8-6178-4cb7-b41f-4551235bd5d7 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:40.948498 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d087aed8-6178-4cb7-b41f-4551235bd5d7 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:40.949330 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d087aed8-6178-4cb7-b41f-4551235bd5d7 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:40.949756 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d087aed8-6178-4cb7-b41f-4551235bd5d7 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:41.046448 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d087aed8-6178-4cb7-b41f-4551235bd5d7 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action" status: 200 len: 32867 microversion: 2.1 time: 0.113736 Nov 16 16:05:41.047304 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 148/278] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:05:40 2021] POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action => generated 32867 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:05:41.052719 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-48db4796-ec58-453a-952a-44fde324ae26 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:41.053602 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-48db4796-ec58-453a-952a-44fde324ae26 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:41.060426 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-48db4796-ec58-453a-952a-44fde324ae26 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:41.060857 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-48db4796-ec58-453a-952a-44fde324ae26 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:41.061741 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-48db4796-ec58-453a-952a-44fde324ae26 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:41.062170 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-48db4796-ec58-453a-952a-44fde324ae26 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:41.142960 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-48db4796-ec58-453a-952a-44fde324ae26 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action" status: 200 len: 33871 microversion: 2.20 time: 0.093150 Nov 16 16:05:41.144112 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 149/279] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:05:41 2021] POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action => generated 33871 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:05:41.948737 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-bbc678ae-69fc-4eb8-97d6-87c11073d1d2 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:41.949527 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-bbc678ae-69fc-4eb8-97d6-87c11073d1d2 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:41.957737 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bbc678ae-69fc-4eb8-97d6-87c11073d1d2 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:41.958198 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bbc678ae-69fc-4eb8-97d6-87c11073d1d2 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:41.959155 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bbc678ae-69fc-4eb8-97d6-87c11073d1d2 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:41.959945 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bbc678ae-69fc-4eb8-97d6-87c11073d1d2 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:42.105274 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-bbc678ae-69fc-4eb8-97d6-87c11073d1d2 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:42.113241 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-bbc678ae-69fc-4eb8-97d6-87c11073d1d2 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1522 microversion: 2.1 time: 0.168718 Nov 16 16:05:42.113813 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 150/280] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:41 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:05:42.118132 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-bce37ec7-0a16-4bc8-a930-556b2d5af294 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:42.119060 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-bce37ec7-0a16-4bc8-a930-556b2d5af294 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:42.124774 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bce37ec7-0a16-4bc8-a930-556b2d5af294 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:42.125229 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bce37ec7-0a16-4bc8-a930-556b2d5af294 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:42.126053 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bce37ec7-0a16-4bc8-a930-556b2d5af294 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:42.126490 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bce37ec7-0a16-4bc8-a930-556b2d5af294 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:42.210072 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-bce37ec7-0a16-4bc8-a930-556b2d5af294 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action" status: 200 len: 33298 microversion: 2.1 time: 0.095002 Nov 16 16:05:42.212863 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 151/281] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:05:42 2021] POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action => generated 33298 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:05:42.216789 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d29ed944-f1bb-46a2-b242-fee66c3e414e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:42.217880 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d29ed944-f1bb-46a2-b242-fee66c3e414e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:42.225684 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d29ed944-f1bb-46a2-b242-fee66c3e414e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:42.226221 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d29ed944-f1bb-46a2-b242-fee66c3e414e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:42.227058 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d29ed944-f1bb-46a2-b242-fee66c3e414e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:42.227578 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d29ed944-f1bb-46a2-b242-fee66c3e414e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:42.306879 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d29ed944-f1bb-46a2-b242-fee66c3e414e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action" status: 200 len: 34826 microversion: 2.20 time: 0.094608 Nov 16 16:05:42.311032 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 152/282] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:05:42 2021] POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action => generated 34826 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:05:43.131624 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-204940fc-d7df-4e25-97fa-452d95da6c02 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:43.132461 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-204940fc-d7df-4e25-97fa-452d95da6c02 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:43.139369 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-204940fc-d7df-4e25-97fa-452d95da6c02 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:43.139917 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-204940fc-d7df-4e25-97fa-452d95da6c02 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:43.140812 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-204940fc-d7df-4e25-97fa-452d95da6c02 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:43.141325 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-204940fc-d7df-4e25-97fa-452d95da6c02 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:43.289745 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-204940fc-d7df-4e25-97fa-452d95da6c02 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:43.297476 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-204940fc-d7df-4e25-97fa-452d95da6c02 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1522 microversion: 2.1 time: 0.169999 Nov 16 16:05:43.297476 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 153/283] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:43 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:05:43.301921 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-5e4c0623-26f8-4a2a-877f-876bb94355e9 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:43.302827 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-5e4c0623-26f8-4a2a-877f-876bb94355e9 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:43.309023 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5e4c0623-26f8-4a2a-877f-876bb94355e9 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:43.309465 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5e4c0623-26f8-4a2a-877f-876bb94355e9 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:43.310417 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5e4c0623-26f8-4a2a-877f-876bb94355e9 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:43.310855 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5e4c0623-26f8-4a2a-877f-876bb94355e9 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:43.392912 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-5e4c0623-26f8-4a2a-877f-876bb94355e9 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action" status: 200 len: 33810 microversion: 2.1 time: 0.094192 Nov 16 16:05:43.397323 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 154/284] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:05:43 2021] POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action => generated 33810 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:05:43.398761 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0f1b5c98-350a-4b54-920f-d52146f304ed tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:43.399779 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0f1b5c98-350a-4b54-920f-d52146f304ed tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:43.406767 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0f1b5c98-350a-4b54-920f-d52146f304ed tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:43.407215 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0f1b5c98-350a-4b54-920f-d52146f304ed tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:43.408016 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0f1b5c98-350a-4b54-920f-d52146f304ed tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:43.408449 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0f1b5c98-350a-4b54-920f-d52146f304ed tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:43.494939 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0f1b5c98-350a-4b54-920f-d52146f304ed tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action" status: 200 len: 35697 microversion: 2.20 time: 0.099833 Nov 16 16:05:43.495872 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 155/285] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:05:43 2021] POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action => generated 35697 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:05:43.944436 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.network.neutron [None req-c36f2955-249e-419e-9826-fee8f1149b33 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] validate_networks() for [('3ab3dac8-cc77-4d96-958c-ff31e1be9045', None, None, None, None, None)] {{(pid=116085) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 16:05:44.310229 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-c36f2955-249e-419e-9826-fee8f1149b33 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Flavor limits 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 16:05:44.310771 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-c36f2955-249e-419e-9826-fee8f1149b33 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Image limits 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 16:05:44.311374 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-c36f2955-249e-419e-9826-fee8f1149b33 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Flavor pref 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 16:05:44.311939 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-c36f2955-249e-419e-9826-fee8f1149b33 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Image pref 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 16:05:44.312354 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-c36f2955-249e-419e-9826-fee8f1149b33 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 16:05:44.320269 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-8b40c287-55e7-485b-9c7a-7df065fb625f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:44.321079 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-8b40c287-55e7-485b-9c7a-7df065fb625f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:44.322197 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c36f2955-249e-419e-9826-fee8f1149b33 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:44.322820 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c36f2955-249e-419e-9826-fee8f1149b33 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:44.323859 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c36f2955-249e-419e-9826-fee8f1149b33 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:44.324484 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c36f2955-249e-419e-9826-fee8f1149b33 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:44.328208 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8b40c287-55e7-485b-9c7a-7df065fb625f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:44.328879 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8b40c287-55e7-485b-9c7a-7df065fb625f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:44.329769 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8b40c287-55e7-485b-9c7a-7df065fb625f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:44.330286 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8b40c287-55e7-485b-9c7a-7df065fb625f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:44.341419 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-c36f2955-249e-419e-9826-fee8f1149b33 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Getting quotas for project 66e03b8724364db290573e549b643dbf. Resources: {'instances', 'ram', 'cores'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:05:44.345408 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-c36f2955-249e-419e-9826-fee8f1149b33 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Getting quotas for user e1d9e7cc0fb849e8a3d067214ac3402a and project 66e03b8724364db290573e549b643dbf. Resources: {'instances', 'ram', 'cores'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:05:44.357541 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-c36f2955-249e-419e-9826-fee8f1149b33 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Going to run 1 instances... {{(pid=116085) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 16:05:44.360212 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-c36f2955-249e-419e-9826-fee8f1149b33 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] [instance: 0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c3bd8e0-8d7e-4cf7-90db-742c4f55e405',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116085) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 16:05:44.420431 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-c36f2955-249e-419e-9826-fee8f1149b33 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.897183 Nov 16 16:05:44.427098 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 131/286] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 16 16:05:36 2021] POST /compute/v2.1/servers => generated 380 bytes in 7904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 16:05:44.432090 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-da4f5780-bf22-4063-bb7c-5ce283d4855e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:44.433297 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-da4f5780-bf22-4063-bb7c-5ce283d4855e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:44.440442 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-da4f5780-bf22-4063-bb7c-5ce283d4855e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:44.442657 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-da4f5780-bf22-4063-bb7c-5ce283d4855e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:44.443819 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-da4f5780-bf22-4063-bb7c-5ce283d4855e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:44.444435 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-da4f5780-bf22-4063-bb7c-5ce283d4855e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:44.525587 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-8b40c287-55e7-485b-9c7a-7df065fb625f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:44.534260 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-8b40c287-55e7-485b-9c7a-7df065fb625f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1522 microversion: 2.1 time: 0.223559 Nov 16 16:05:44.535645 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 156/287] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:44 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:05:44.540523 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-50a88ad4-7827-49a6-bd93-49eab3a2cf52 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:44.541301 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-50a88ad4-7827-49a6-bd93-49eab3a2cf52 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] [instance: 0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:44.553329 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-da4f5780-bf22-4063-bb7c-5ce283d4855e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action" status: 200 len: 34559 microversion: 2.1 time: 0.124546 Nov 16 16:05:44.558372 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 132/288] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:05:44 2021] POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action => generated 34559 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:05:44.564358 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-670a54db-97f3-4871-82fb-aa8e39780f61 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:44.565602 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-670a54db-97f3-4871-82fb-aa8e39780f61 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:44.574352 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-670a54db-97f3-4871-82fb-aa8e39780f61 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:44.574863 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-670a54db-97f3-4871-82fb-aa8e39780f61 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:44.575757 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-670a54db-97f3-4871-82fb-aa8e39780f61 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:44.576350 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-670a54db-97f3-4871-82fb-aa8e39780f61 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:44.602672 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-50a88ad4-7827-49a6-bd93-49eab3a2cf52 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d9e7cc0fb849e8a3d067214ac3402a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e03b8724364db290573e549b643dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:44.610383 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-50a88ad4-7827-49a6-bd93-49eab3a2cf52 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] 10.222.0.46 "GET /compute/v2.1/servers/0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5" status: 200 len: 1213 microversion: 2.1 time: 0.073188 Nov 16 16:05:44.611821 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 157/289] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:44 2021] GET /compute/v2.1/servers/0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5 => generated 1213 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:05:44.675403 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-670a54db-97f3-4871-82fb-aa8e39780f61 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action" status: 200 len: 36710 microversion: 2.20 time: 0.115592 Nov 16 16:05:44.676980 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 133/290] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:05:44 2021] POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action => generated 36710 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:05:45.551657 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-089fa1bf-a66e-4b32-b43c-a40726d870bc tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:45.552961 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-089fa1bf-a66e-4b32-b43c-a40726d870bc tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:45.559856 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-089fa1bf-a66e-4b32-b43c-a40726d870bc tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:45.560607 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-089fa1bf-a66e-4b32-b43c-a40726d870bc tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:45.561618 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-089fa1bf-a66e-4b32-b43c-a40726d870bc tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:45.562254 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-089fa1bf-a66e-4b32-b43c-a40726d870bc tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:45.571006 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-ad1f99ab-60eb-466d-989c-cfa190e61df5 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:45.577541 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-ad1f99ab-60eb-466d-989c-cfa190e61df5 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:45.594006 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ad1f99ab-60eb-466d-989c-cfa190e61df5 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:45.594524 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ad1f99ab-60eb-466d-989c-cfa190e61df5 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:45.595384 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ad1f99ab-60eb-466d-989c-cfa190e61df5 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:45.595912 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ad1f99ab-60eb-466d-989c-cfa190e61df5 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:45.698448 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-ad1f99ab-60eb-466d-989c-cfa190e61df5 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action" status: 200 len: 35307 microversion: 2.1 time: 0.136498 Nov 16 16:05:45.699423 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 134/291] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:05:45 2021] POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action => generated 35307 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:05:45.709534 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-96d761fc-e453-4f0f-a1a5-118415601c0c tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:45.710840 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-96d761fc-e453-4f0f-a1a5-118415601c0c tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] [instance: 0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:45.726773 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-089fa1bf-a66e-4b32-b43c-a40726d870bc tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:45.735679 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-089fa1bf-a66e-4b32-b43c-a40726d870bc tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1522 microversion: 2.1 time: 0.187800 Nov 16 16:05:45.736249 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 158/292] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:45 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:05:45.743886 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0f29d5b1-866e-4bec-aa40-24bccf4a7a19 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:45.744353 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-96d761fc-e453-4f0f-a1a5-118415601c0c tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:45.744801 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-96d761fc-e453-4f0f-a1a5-118415601c0c tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:45.745079 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0f29d5b1-866e-4bec-aa40-24bccf4a7a19 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:45.745587 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-96d761fc-e453-4f0f-a1a5-118415601c0c tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:45.746013 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-96d761fc-e453-4f0f-a1a5-118415601c0c tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:45.751029 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0f29d5b1-866e-4bec-aa40-24bccf4a7a19 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:45.751701 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0f29d5b1-866e-4bec-aa40-24bccf4a7a19 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:45.752906 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0f29d5b1-866e-4bec-aa40-24bccf4a7a19 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:45.754340 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0f29d5b1-866e-4bec-aa40-24bccf4a7a19 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:45.811081 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-96d761fc-e453-4f0f-a1a5-118415601c0c tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d9e7cc0fb849e8a3d067214ac3402a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e03b8724364db290573e549b643dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:45.819392 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-96d761fc-e453-4f0f-a1a5-118415601c0c tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] 10.222.0.46 "GET /compute/v2.1/servers/0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5" status: 200 len: 1271 microversion: 2.1 time: 0.118499 Nov 16 16:05:45.821752 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 135/293] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:45 2021] GET /compute/v2.1/servers/0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5 => generated 1271 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:05:45.838488 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0f29d5b1-866e-4bec-aa40-24bccf4a7a19 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action" status: 200 len: 37580 microversion: 2.20 time: 0.100785 Nov 16 16:05:45.842806 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 159/294] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:05:45 2021] POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action => generated 37580 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:05:46.711821 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-bef461e4-e804-4022-bf29-8c19972281d3 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:46.712730 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-bef461e4-e804-4022-bf29-8c19972281d3 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:46.719004 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bef461e4-e804-4022-bf29-8c19972281d3 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:46.719448 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bef461e4-e804-4022-bf29-8c19972281d3 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:46.720261 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bef461e4-e804-4022-bf29-8c19972281d3 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:46.720686 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bef461e4-e804-4022-bf29-8c19972281d3 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:46.754394 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-76cbb4ed-19fa-4ef5-89db-0e5301ecf374 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:46.755090 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-76cbb4ed-19fa-4ef5-89db-0e5301ecf374 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:46.761872 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-76cbb4ed-19fa-4ef5-89db-0e5301ecf374 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:46.762315 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-76cbb4ed-19fa-4ef5-89db-0e5301ecf374 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:46.763088 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-76cbb4ed-19fa-4ef5-89db-0e5301ecf374 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:46.763544 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-76cbb4ed-19fa-4ef5-89db-0e5301ecf374 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:46.808205 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-bef461e4-e804-4022-bf29-8c19972281d3 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action" status: 200 len: 35933 microversion: 2.1 time: 0.100910 Nov 16 16:05:46.809118 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 136/295] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:05:46 2021] POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action => generated 35933 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 16:05:46.841131 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-6ad63e08-0db8-4947-bb0a-fbcb5ef8a5a3 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:46.841828 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-6ad63e08-0db8-4947-bb0a-fbcb5ef8a5a3 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] [instance: 0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:46.851499 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6ad63e08-0db8-4947-bb0a-fbcb5ef8a5a3 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:46.851499 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6ad63e08-0db8-4947-bb0a-fbcb5ef8a5a3 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:46.851499 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6ad63e08-0db8-4947-bb0a-fbcb5ef8a5a3 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:46.851499 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6ad63e08-0db8-4947-bb0a-fbcb5ef8a5a3 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:46.956426 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-76cbb4ed-19fa-4ef5-89db-0e5301ecf374 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:46.967007 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-76cbb4ed-19fa-4ef5-89db-0e5301ecf374 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1522 microversion: 2.1 time: 0.216689 Nov 16 16:05:46.967618 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 160/296] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:46 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:05:46.972864 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c3fde794-09cb-4000-9d2f-ffc67bb19cca tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:46.975114 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c3fde794-09cb-4000-9d2f-ffc67bb19cca tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:46.981231 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c3fde794-09cb-4000-9d2f-ffc67bb19cca tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:46.981681 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c3fde794-09cb-4000-9d2f-ffc67bb19cca tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:46.982894 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c3fde794-09cb-4000-9d2f-ffc67bb19cca tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:46.983501 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c3fde794-09cb-4000-9d2f-ffc67bb19cca tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:47.031297 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-6ad63e08-0db8-4947-bb0a-fbcb5ef8a5a3 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d9e7cc0fb849e8a3d067214ac3402a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e03b8724364db290573e549b643dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:47.038792 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-6ad63e08-0db8-4947-bb0a-fbcb5ef8a5a3 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] 10.222.0.46 "GET /compute/v2.1/servers/0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5" status: 200 len: 1313 microversion: 2.1 time: 0.203190 Nov 16 16:05:47.039498 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 137/297] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:46 2021] GET /compute/v2.1/servers/0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5 => generated 1313 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:05:47.043788 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-c9b4d935-acc0-40e3-bd9d-58510a01244b req-31ab365e-4d2c-456e-aeef-526bbb0c4f9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5", "tag": "406850df-9b38-43ec-be90-cae97c408b1b"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:47.045338 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:05:47.045338 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Nov 16 16:05:47.052232 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-c9b4d935-acc0-40e3-bd9d-58510a01244b req-31ab365e-4d2c-456e-aeef-526bbb0c4f9e service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:47.052671 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-c9b4d935-acc0-40e3-bd9d-58510a01244b req-31ab365e-4d2c-456e-aeef-526bbb0c4f9e service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:47.062946 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-c9b4d935-acc0-40e3-bd9d-58510a01244b req-31ab365e-4d2c-456e-aeef-526bbb0c4f9e service nova] Creating event network-changed:406850df-9b38-43ec-be90-cae97c408b1b for instance 0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5 on hv-cinder-81809 Nov 16 16:05:47.068207 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-c9b4d935-acc0-40e3-bd9d-58510a01244b req-31ab365e-4d2c-456e-aeef-526bbb0c4f9e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027588 Nov 16 16:05:47.070663 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 138/298] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:05:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:05:47.072735 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c3fde794-09cb-4000-9d2f-ffc67bb19cca tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action" status: 200 len: 38188 microversion: 2.20 time: 0.103560 Nov 16 16:05:47.073376 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 161/299] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:05:46 2021] POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action => generated 38188 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:05:47.822321 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-f1772ad8-76c9-4b3f-8062-afdd06bef577 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:47.823551 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-f1772ad8-76c9-4b3f-8062-afdd06bef577 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:47.830339 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f1772ad8-76c9-4b3f-8062-afdd06bef577 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:47.830798 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f1772ad8-76c9-4b3f-8062-afdd06bef577 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:47.831639 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f1772ad8-76c9-4b3f-8062-afdd06bef577 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:47.832072 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f1772ad8-76c9-4b3f-8062-afdd06bef577 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:47.941411 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-f1772ad8-76c9-4b3f-8062-afdd06bef577 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action" status: 200 len: 36656 microversion: 2.1 time: 0.123660 Nov 16 16:05:47.945613 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 139/300] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:05:47 2021] POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action => generated 36656 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:05:47.984258 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-5a3cee80-b7a0-40fa-955f-c9d3f00aab99 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:47.984957 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-5a3cee80-b7a0-40fa-955f-c9d3f00aab99 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:47.992025 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5a3cee80-b7a0-40fa-955f-c9d3f00aab99 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:47.992474 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5a3cee80-b7a0-40fa-955f-c9d3f00aab99 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:47.993246 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5a3cee80-b7a0-40fa-955f-c9d3f00aab99 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:47.993686 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5a3cee80-b7a0-40fa-955f-c9d3f00aab99 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:48.055997 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-5340f3e0-cf55-41b4-b32f-c4855860d8c1 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:48.056705 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-5340f3e0-cf55-41b4-b32f-c4855860d8c1 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] [instance: 0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:48.063920 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5340f3e0-cf55-41b4-b32f-c4855860d8c1 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:48.064366 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5340f3e0-cf55-41b4-b32f-c4855860d8c1 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:48.065362 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5340f3e0-cf55-41b4-b32f-c4855860d8c1 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:48.065968 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5340f3e0-cf55-41b4-b32f-c4855860d8c1 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:48.175261 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-5a3cee80-b7a0-40fa-955f-c9d3f00aab99 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:48.182880 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-5a3cee80-b7a0-40fa-955f-c9d3f00aab99 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1522 microversion: 2.1 time: 0.202579 Nov 16 16:05:48.183453 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 162/301] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:47 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:05:48.187876 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-718032de-a798-42b3-a71e-8643dee7ea6a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:48.188888 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-718032de-a798-42b3-a71e-8643dee7ea6a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:48.194767 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-718032de-a798-42b3-a71e-8643dee7ea6a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:48.195141 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-718032de-a798-42b3-a71e-8643dee7ea6a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:48.195973 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-718032de-a798-42b3-a71e-8643dee7ea6a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:48.196411 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-718032de-a798-42b3-a71e-8643dee7ea6a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:48.247981 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-5340f3e0-cf55-41b4-b32f-c4855860d8c1 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d9e7cc0fb849e8a3d067214ac3402a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e03b8724364db290573e549b643dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:48.255159 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-5340f3e0-cf55-41b4-b32f-c4855860d8c1 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] 10.222.0.46 "GET /compute/v2.1/servers/0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5" status: 200 len: 1313 microversion: 2.1 time: 0.203273 Nov 16 16:05:48.255749 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 140/302] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:48 2021] GET /compute/v2.1/servers/0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5 => generated 1313 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:05:48.286730 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-718032de-a798-42b3-a71e-8643dee7ea6a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action" status: 200 len: 38226 microversion: 2.20 time: 0.102005 Nov 16 16:05:48.290851 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 163/303] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:05:48 2021] POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action => generated 38226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:05:48.953812 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-39a63c6d-04c9-46c9-bf14-e503eaef4fad tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:48.954761 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-39a63c6d-04c9-46c9-bf14-e503eaef4fad tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:48.961654 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-39a63c6d-04c9-46c9-bf14-e503eaef4fad tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:48.962140 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-39a63c6d-04c9-46c9-bf14-e503eaef4fad tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:48.962959 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-39a63c6d-04c9-46c9-bf14-e503eaef4fad tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:48.963634 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-39a63c6d-04c9-46c9-bf14-e503eaef4fad tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:49.041512 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-39a63c6d-04c9-46c9-bf14-e503eaef4fad tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action" status: 200 len: 37363 microversion: 2.1 time: 0.091679 Nov 16 16:05:49.046176 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 141/304] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:05:48 2021] POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action => generated 37363 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:05:49.200228 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f0b80821-14d7-4a47-ba17-029fb390dba3 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:49.201487 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f0b80821-14d7-4a47-ba17-029fb390dba3 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:49.208354 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f0b80821-14d7-4a47-ba17-029fb390dba3 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:49.208818 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f0b80821-14d7-4a47-ba17-029fb390dba3 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:49.209696 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f0b80821-14d7-4a47-ba17-029fb390dba3 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:49.210091 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f0b80821-14d7-4a47-ba17-029fb390dba3 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:49.272314 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-b0fc0df3-0256-401f-b93d-5d8cb2c08a3a tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:49.273024 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-b0fc0df3-0256-401f-b93d-5d8cb2c08a3a tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] [instance: 0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:49.280449 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b0fc0df3-0256-401f-b93d-5d8cb2c08a3a tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:49.280900 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b0fc0df3-0256-401f-b93d-5d8cb2c08a3a tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:49.281693 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b0fc0df3-0256-401f-b93d-5d8cb2c08a3a tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:49.282127 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b0fc0df3-0256-401f-b93d-5d8cb2c08a3a tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:49.382837 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f0b80821-14d7-4a47-ba17-029fb390dba3 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:49.390243 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f0b80821-14d7-4a47-ba17-029fb390dba3 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1522 microversion: 2.1 time: 0.194046 Nov 16 16:05:49.390808 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 164/305] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:49 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:05:49.395341 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e9e16e51-a1e0-4b34-91f9-8178ff188420 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:49.396490 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e9e16e51-a1e0-4b34-91f9-8178ff188420 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:49.403174 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e9e16e51-a1e0-4b34-91f9-8178ff188420 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:49.403674 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e9e16e51-a1e0-4b34-91f9-8178ff188420 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:49.404462 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e9e16e51-a1e0-4b34-91f9-8178ff188420 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:49.404898 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e9e16e51-a1e0-4b34-91f9-8178ff188420 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:49.448950 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-b0fc0df3-0256-401f-b93d-5d8cb2c08a3a tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d9e7cc0fb849e8a3d067214ac3402a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e03b8724364db290573e549b643dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:49.458689 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-b0fc0df3-0256-401f-b93d-5d8cb2c08a3a tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] 10.222.0.46 "GET /compute/v2.1/servers/0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5" status: 200 len: 1313 microversion: 2.1 time: 0.190074 Nov 16 16:05:49.459800 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 142/306] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:49 2021] GET /compute/v2.1/servers/0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5 => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:05:49.478330 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e9e16e51-a1e0-4b34-91f9-8178ff188420 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action" status: 200 len: 38366 microversion: 2.20 time: 0.086276 Nov 16 16:05:49.478985 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 165/307] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:05:49 2021] POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action => generated 38366 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:05:49.488861 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-a3c0e368-6e80-47e2-84cd-20e542c2b096 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:49.489300 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-a3c0e368-6e80-47e2-84cd-20e542c2b096 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:49.495234 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a3c0e368-6e80-47e2-84cd-20e542c2b096 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:49.495716 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a3c0e368-6e80-47e2-84cd-20e542c2b096 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:49.496499 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a3c0e368-6e80-47e2-84cd-20e542c2b096 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:49.496935 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a3c0e368-6e80-47e2-84cd-20e542c2b096 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:49.519952 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-a3c0e368-6e80-47e2-84cd-20e542c2b096 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/ips" status: 200 len: 151 microversion: 2.20 time: 0.034426 Nov 16 16:05:49.520522 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 143/308] 10.222.0.46 () {60 vars in 1288 bytes} [Tue Nov 16 16:05:49 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/ips => generated 151 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:05:49.967992 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-4d00390b-14b0-4e58-bb16-0eb4ea9b93c5 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1419557720", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1166381435", "security_groups": [{"name": "tempest-secgroup-smoke-1125201303"}], "block_device_mapping_v2": [{"uuid": "72d6c230-f6e4-4686-8a34-aa6f6c77a911", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d76e01f2-cefd-4113-8b4c-ae0a7cc24037"}]}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:50.053760 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-51ec3726-78df-46cf-b690-c137fb085543 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:50.054714 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-51ec3726-78df-46cf-b690-c137fb085543 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:50.061069 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-51ec3726-78df-46cf-b690-c137fb085543 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:50.061517 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-51ec3726-78df-46cf-b690-c137fb085543 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:50.062295 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-51ec3726-78df-46cf-b690-c137fb085543 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:50.062739 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-51ec3726-78df-46cf-b690-c137fb085543 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:50.079304 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.network.neutron [None req-4d00390b-14b0-4e58-bb16-0eb4ea9b93c5 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] validate_networks() for [('d76e01f2-cefd-4113-8b4c-ae0a7cc24037', None, None, None, None, None)] {{(pid=116084) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 16:05:50.147081 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-51ec3726-78df-46cf-b690-c137fb085543 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action" status: 200 len: 38142 microversion: 2.1 time: 0.097015 Nov 16 16:05:50.151436 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 144/309] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:05:50 2021] POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action => generated 38142 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 16:05:50.408323 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-7e522dfc-108f-4b8f-915a-0111c353c598 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:50.409091 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-7e522dfc-108f-4b8f-915a-0111c353c598 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:50.416694 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7e522dfc-108f-4b8f-915a-0111c353c598 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:50.417215 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7e522dfc-108f-4b8f-915a-0111c353c598 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:50.418059 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7e522dfc-108f-4b8f-915a-0111c353c598 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:50.418487 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7e522dfc-108f-4b8f-915a-0111c353c598 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:50.512288 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-4d00390b-14b0-4e58-bb16-0eb4ea9b93c5 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Flavor limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 16:05:50.513421 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-4d00390b-14b0-4e58-bb16-0eb4ea9b93c5 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Image limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 16:05:50.513901 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-4d00390b-14b0-4e58-bb16-0eb4ea9b93c5 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Flavor pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 16:05:50.514310 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-4d00390b-14b0-4e58-bb16-0eb4ea9b93c5 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Image pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 16:05:50.514725 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-4d00390b-14b0-4e58-bb16-0eb4ea9b93c5 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 16:05:50.523862 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4d00390b-14b0-4e58-bb16-0eb4ea9b93c5 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:50.524309 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4d00390b-14b0-4e58-bb16-0eb4ea9b93c5 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:50.525124 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4d00390b-14b0-4e58-bb16-0eb4ea9b93c5 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:50.525559 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4d00390b-14b0-4e58-bb16-0eb4ea9b93c5 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:50.542772 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-4d00390b-14b0-4e58-bb16-0eb4ea9b93c5 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Getting quotas for project d2bdf7025cb744f088b95cb0bba5169b. Resources: {'instances', 'ram', 'cores'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:05:50.547085 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-4d00390b-14b0-4e58-bb16-0eb4ea9b93c5 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Getting quotas for user d363b1ed870843a6ba751e0d1ea0bd1e and project d2bdf7025cb744f088b95cb0bba5169b. Resources: {'instances', 'ram', 'cores'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:05:50.590986 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-7e522dfc-108f-4b8f-915a-0111c353c598 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:50.601111 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-7e522dfc-108f-4b8f-915a-0111c353c598 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1522 microversion: 2.1 time: 0.196804 Nov 16 16:05:50.610908 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 145/310] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:50 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:05:50.610908 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-3b1b298e-6634-49ec-b33a-26a9d68e0893 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:50.610908 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-3b1b298e-6634-49ec-b33a-26a9d68e0893 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] [instance: 0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:50.615093 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3b1b298e-6634-49ec-b33a-26a9d68e0893 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:50.615241 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-4d00390b-14b0-4e58-bb16-0eb4ea9b93c5 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Going to run 1 instances... {{(pid=116084) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 16:05:50.615573 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3b1b298e-6634-49ec-b33a-26a9d68e0893 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:50.616363 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3b1b298e-6634-49ec-b33a-26a9d68e0893 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:50.616984 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3b1b298e-6634-49ec-b33a-26a9d68e0893 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:50.618017 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-4d00390b-14b0-4e58-bb16-0eb4ea9b93c5 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: db94bd78-8ff3-4784-84bd-e09796f6633a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='72d6c230-f6e4-4686-8a34-aa6f6c77a911',volume_size=None,volume_type=None)] {{(pid=116084) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 16:05:50.794170 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-3b1b298e-6634-49ec-b33a-26a9d68e0893 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d9e7cc0fb849e8a3d067214ac3402a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e03b8724364db290573e549b643dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:50.799814 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-4d00390b-14b0-4e58-bb16-0eb4ea9b93c5 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.835586 Nov 16 16:05:50.801232 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 166/311] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 16 16:05:49 2021] POST /compute/v2.1/servers => generated 406 bytes in 837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 16 16:05:50.807065 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-3b1b298e-6634-49ec-b33a-26a9d68e0893 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] 10.222.0.46 "GET /compute/v2.1/servers/0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5" status: 200 len: 1313 microversion: 2.1 time: 0.202299 Nov 16 16:05:50.808791 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 146/312] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:50 2021] GET /compute/v2.1/servers/0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5 => generated 1313 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:05:50.822710 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a24d668e-56fe-44a7-b663-bcd1215c9f3a tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:50.823735 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-a24d668e-56fe-44a7-b663-bcd1215c9f3a tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: db94bd78-8ff3-4784-84bd-e09796f6633a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:50.883534 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-a24d668e-56fe-44a7-b663-bcd1215c9f3a tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:50.890075 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-a24d668e-56fe-44a7-b663-bcd1215c9f3a tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a" status: 200 len: 1095 microversion: 2.1 time: 0.073918 Nov 16 16:05:50.890622 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 167/313] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:50 2021] GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a => generated 1095 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:05:51.158457 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-b65b0dec-2272-4337-8515-2f1d463dd5c2 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:51.159982 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-b65b0dec-2272-4337-8515-2f1d463dd5c2 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:51.166636 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b65b0dec-2272-4337-8515-2f1d463dd5c2 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:51.167075 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b65b0dec-2272-4337-8515-2f1d463dd5c2 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:51.167892 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b65b0dec-2272-4337-8515-2f1d463dd5c2 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:51.168321 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b65b0dec-2272-4337-8515-2f1d463dd5c2 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:51.238881 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-b65b0dec-2272-4337-8515-2f1d463dd5c2 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action" status: 200 len: 38142 microversion: 2.1 time: 0.083404 Nov 16 16:05:51.239653 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 147/314] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:05:51 2021] POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action => generated 38142 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:05:51.618901 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-755b2d05-006f-476c-b0c4-985765d6a8cb tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:51.619548 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-755b2d05-006f-476c-b0c4-985765d6a8cb tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:51.626966 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-755b2d05-006f-476c-b0c4-985765d6a8cb tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:51.627441 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-755b2d05-006f-476c-b0c4-985765d6a8cb tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:51.628237 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-755b2d05-006f-476c-b0c4-985765d6a8cb tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:51.628681 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-755b2d05-006f-476c-b0c4-985765d6a8cb tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:51.762777 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-755b2d05-006f-476c-b0c4-985765d6a8cb tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:51.771197 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-755b2d05-006f-476c-b0c4-985765d6a8cb tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1522 microversion: 2.1 time: 0.155800 Nov 16 16:05:51.771893 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 168/315] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:51 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:05:51.829278 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-69124841-d581-4880-a5e2-4d1b26ed5618 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:51.829972 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-69124841-d581-4880-a5e2-4d1b26ed5618 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] [instance: 0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:51.838518 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-69124841-d581-4880-a5e2-4d1b26ed5618 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:51.838871 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-69124841-d581-4880-a5e2-4d1b26ed5618 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:51.839853 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-69124841-d581-4880-a5e2-4d1b26ed5618 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:51.840280 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-69124841-d581-4880-a5e2-4d1b26ed5618 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:51.912627 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-23260a59-c7b3-4383-9b9c-6610bfc68a5a tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:51.913401 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-23260a59-c7b3-4383-9b9c-6610bfc68a5a tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: db94bd78-8ff3-4784-84bd-e09796f6633a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:51.921796 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-23260a59-c7b3-4383-9b9c-6610bfc68a5a tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:51.922439 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-23260a59-c7b3-4383-9b9c-6610bfc68a5a tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:51.923718 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-23260a59-c7b3-4383-9b9c-6610bfc68a5a tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:51.924331 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-23260a59-c7b3-4383-9b9c-6610bfc68a5a tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:52.003948 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-23260a59-c7b3-4383-9b9c-6610bfc68a5a tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:52.009144 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-69124841-d581-4880-a5e2-4d1b26ed5618 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d9e7cc0fb849e8a3d067214ac3402a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e03b8724364db290573e549b643dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:52.013006 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-23260a59-c7b3-4383-9b9c-6610bfc68a5a tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a" status: 200 len: 1193 microversion: 2.1 time: 0.107556 Nov 16 16:05:52.023892 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 169/316] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:51 2021] GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a => generated 1193 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:05:52.026105 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-69124841-d581-4880-a5e2-4d1b26ed5618 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] 10.222.0.46 "GET /compute/v2.1/servers/0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5" status: 200 len: 1313 microversion: 2.1 time: 0.201290 Nov 16 16:05:52.028135 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 148/317] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:51 2021] GET /compute/v2.1/servers/0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5 => generated 1313 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:05:52.031505 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e8f676c1-40de-4c92-97ba-35f9506d55d8 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:52.031505 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e8f676c1-40de-4c92-97ba-35f9506d55d8 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:52.038025 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e8f676c1-40de-4c92-97ba-35f9506d55d8 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:52.038680 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e8f676c1-40de-4c92-97ba-35f9506d55d8 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:52.039710 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e8f676c1-40de-4c92-97ba-35f9506d55d8 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:52.040152 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e8f676c1-40de-4c92-97ba-35f9506d55d8 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:52.065316 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.objects.instance [None req-e8f676c1-40de-4c92-97ba-35f9506d55d8 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lazy-loading 'flavor' on Instance uuid 6447972e-6291-4e68-8271-c93523206230 {{(pid=116084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:05:52.251262 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-22018a24-bec9-45a2-970e-ebd2229518b0 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:52.252234 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-22018a24-bec9-45a2-970e-ebd2229518b0 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:52.259718 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-22018a24-bec9-45a2-970e-ebd2229518b0 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:52.260184 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-22018a24-bec9-45a2-970e-ebd2229518b0 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:52.261153 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-22018a24-bec9-45a2-970e-ebd2229518b0 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:52.261611 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-22018a24-bec9-45a2-970e-ebd2229518b0 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:52.381417 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e8f676c1-40de-4c92-97ba-35f9506d55d8 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action" status: 202 len: 0 microversion: 2.20 time: 0.356177 Nov 16 16:05:52.382134 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 170/318] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:05:52 2021] POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 16 16:05:52.395167 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-29af13fa-b448-43d7-9228-c55c3a5d2c0b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:52.396845 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-29af13fa-b448-43d7-9228-c55c3a5d2c0b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:52.407715 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-29af13fa-b448-43d7-9228-c55c3a5d2c0b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:52.408685 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-29af13fa-b448-43d7-9228-c55c3a5d2c0b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:52.410365 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-29af13fa-b448-43d7-9228-c55c3a5d2c0b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:52.411028 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-29af13fa-b448-43d7-9228-c55c3a5d2c0b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:52.585061 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-29af13fa-b448-43d7-9228-c55c3a5d2c0b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:52.585344 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-22018a24-bec9-45a2-970e-ebd2229518b0 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action" status: 200 len: 38269 microversion: 2.1 time: 0.337532 Nov 16 16:05:52.586090 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 149/319] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:05:52 2021] POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action => generated 38269 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:05:52.595446 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-29af13fa-b448-43d7-9228-c55c3a5d2c0b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:52.596781 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-1bb677e9-a6fd-454e-900c-8f0170d98d48 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:52.597432 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-1bb677e9-a6fd-454e-900c-8f0170d98d48 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:52.603947 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-29af13fa-b448-43d7-9228-c55c3a5d2c0b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:52.605386 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-29af13fa-b448-43d7-9228-c55c3a5d2c0b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1723 microversion: 2.20 time: 0.217890 Nov 16 16:05:52.606314 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 171/320] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:05:52 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:05:52.607889 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1bb677e9-a6fd-454e-900c-8f0170d98d48 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:52.608479 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1bb677e9-a6fd-454e-900c-8f0170d98d48 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:52.609290 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1bb677e9-a6fd-454e-900c-8f0170d98d48 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:52.610135 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1bb677e9-a6fd-454e-900c-8f0170d98d48 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:52.652591 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-1bb677e9-a6fd-454e-900c-8f0170d98d48 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/ips" status: 200 len: 144 microversion: 2.1 time: 0.059595 Nov 16 16:05:52.653276 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 150/321] 10.222.0.46 () {58 vars in 1247 bytes} [Tue Nov 16 16:05:52 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/ips => generated 144 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:05:52.712869 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-35794ed1-35f1-47bd-9a59-bcde59def6b7 req-d8c96513-6eb0-43ef-af21-a4de384ede7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5", "name": "network-vif-plugged", "status": "completed", "tag": "406850df-9b38-43ec-be90-cae97c408b1b"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:52.714625 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:05:52.714625 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Nov 16 16:05:52.724097 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-35794ed1-35f1-47bd-9a59-bcde59def6b7 req-d8c96513-6eb0-43ef-af21-a4de384ede7f service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:52.724798 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-35794ed1-35f1-47bd-9a59-bcde59def6b7 req-d8c96513-6eb0-43ef-af21-a4de384ede7f service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:52.747980 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-35794ed1-35f1-47bd-9a59-bcde59def6b7 req-d8c96513-6eb0-43ef-af21-a4de384ede7f service nova] Creating event network-vif-plugged:406850df-9b38-43ec-be90-cae97c408b1b for instance 0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5 on hv-cinder-81809 Nov 16 16:05:52.754183 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-35794ed1-35f1-47bd-9a59-bcde59def6b7 req-d8c96513-6eb0-43ef-af21-a4de384ede7f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044811 Nov 16 16:05:52.755440 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 172/322] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:05:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:05:52.788699 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-8cdec7e7-924d-43a0-96f9-0f39126f383b tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:52.789850 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-8cdec7e7-924d-43a0-96f9-0f39126f383b tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:52.809901 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8cdec7e7-924d-43a0-96f9-0f39126f383b tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:52.812762 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8cdec7e7-924d-43a0-96f9-0f39126f383b tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:52.813592 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8cdec7e7-924d-43a0-96f9-0f39126f383b tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:52.817104 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8cdec7e7-924d-43a0-96f9-0f39126f383b tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:53.021579 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-8cdec7e7-924d-43a0-96f9-0f39126f383b tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:53.031521 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ecf26753-70c9-4aa9-ba35-b3f5967fe6ab tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:53.032641 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ecf26753-70c9-4aa9-ba35-b3f5967fe6ab tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: db94bd78-8ff3-4784-84bd-e09796f6633a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:53.035368 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-8cdec7e7-924d-43a0-96f9-0f39126f383b tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1522 microversion: 2.1 time: 0.246973 Nov 16 16:05:53.037249 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 151/323] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:52 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:05:53.040904 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ecf26753-70c9-4aa9-ba35-b3f5967fe6ab tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:53.041536 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ecf26753-70c9-4aa9-ba35-b3f5967fe6ab tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:53.042737 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ecf26753-70c9-4aa9-ba35-b3f5967fe6ab tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:53.043474 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ecf26753-70c9-4aa9-ba35-b3f5967fe6ab tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:53.045848 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-35b8e6eb-a17a-4395-ac0e-6d22349c5469 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:53.046577 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-35b8e6eb-a17a-4395-ac0e-6d22349c5469 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] [instance: 0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:53.055504 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-35b8e6eb-a17a-4395-ac0e-6d22349c5469 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:53.056741 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-35b8e6eb-a17a-4395-ac0e-6d22349c5469 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:53.057747 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-35b8e6eb-a17a-4395-ac0e-6d22349c5469 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:53.058387 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-35b8e6eb-a17a-4395-ac0e-6d22349c5469 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:53.304712 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-35b8e6eb-a17a-4395-ac0e-6d22349c5469 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d9e7cc0fb849e8a3d067214ac3402a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e03b8724364db290573e549b643dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:53.307847 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ecf26753-70c9-4aa9-ba35-b3f5967fe6ab tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:53.317687 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ecf26753-70c9-4aa9-ba35-b3f5967fe6ab tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a" status: 200 len: 1267 microversion: 2.1 time: 0.290747 Nov 16 16:05:53.318666 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-35b8e6eb-a17a-4395-ac0e-6d22349c5469 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] 10.222.0.46 "GET /compute/v2.1/servers/0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5" status: 200 len: 1313 microversion: 2.1 time: 0.276881 Nov 16 16:05:53.318894 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 173/324] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:53 2021] GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a => generated 1267 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:05:53.319579 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 152/325] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:53 2021] GET /compute/v2.1/servers/0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5 => generated 1313 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:05:53.626189 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-4200ccec-9796-49db-9e7c-9cb2c0aac443 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:53.627133 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-4200ccec-9796-49db-9e7c-9cb2c0aac443 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:53.640232 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4200ccec-9796-49db-9e7c-9cb2c0aac443 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:53.640987 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4200ccec-9796-49db-9e7c-9cb2c0aac443 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:53.641879 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4200ccec-9796-49db-9e7c-9cb2c0aac443 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:53.642409 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4200ccec-9796-49db-9e7c-9cb2c0aac443 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:53.785148 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-790e5da2-f0c6-4d41-a2a2-c3a6b96b485b req-083438db-0c0d-491a-a95e-62bcb5f74fed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db94bd78-8ff3-4784-84bd-e09796f6633a", "tag": "b063cfec-1c51-450b-a10e-50021e43d561"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:53.786797 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:05:53.786797 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Nov 16 16:05:53.803724 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-790e5da2-f0c6-4d41-a2a2-c3a6b96b485b req-083438db-0c0d-491a-a95e-62bcb5f74fed service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:53.804508 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-790e5da2-f0c6-4d41-a2a2-c3a6b96b485b req-083438db-0c0d-491a-a95e-62bcb5f74fed service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:53.831328 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-790e5da2-f0c6-4d41-a2a2-c3a6b96b485b req-083438db-0c0d-491a-a95e-62bcb5f74fed service nova] Creating event network-changed:b063cfec-1c51-450b-a10e-50021e43d561 for instance db94bd78-8ff3-4784-84bd-e09796f6633a on hv-cinder-81809 Nov 16 16:05:53.837812 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-790e5da2-f0c6-4d41-a2a2-c3a6b96b485b req-083438db-0c0d-491a-a95e-62bcb5f74fed service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057346 Nov 16 16:05:53.839159 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 153/326] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:05:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:05:53.951686 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-4200ccec-9796-49db-9e7c-9cb2c0aac443 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:53.963960 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-4200ccec-9796-49db-9e7c-9cb2c0aac443 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:53.970200 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-4200ccec-9796-49db-9e7c-9cb2c0aac443 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:53.972756 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-4200ccec-9796-49db-9e7c-9cb2c0aac443 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1723 microversion: 2.20 time: 0.349868 Nov 16 16:05:53.988047 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 174/327] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:05:53 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1723 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:05:54.058607 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-6dfa6a46-d21f-4f86-8664-8c2c2e733f32 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:54.060219 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-6dfa6a46-d21f-4f86-8664-8c2c2e733f32 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:54.070885 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6dfa6a46-d21f-4f86-8664-8c2c2e733f32 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:54.071572 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6dfa6a46-d21f-4f86-8664-8c2c2e733f32 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:54.072709 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6dfa6a46-d21f-4f86-8664-8c2c2e733f32 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:54.073327 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6dfa6a46-d21f-4f86-8664-8c2c2e733f32 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:54.340513 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-65653449-0bcb-444f-9437-e66f0989dfb2 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:54.342755 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-65653449-0bcb-444f-9437-e66f0989dfb2 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: db94bd78-8ff3-4784-84bd-e09796f6633a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:54.353430 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-65653449-0bcb-444f-9437-e66f0989dfb2 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:54.353886 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-65653449-0bcb-444f-9437-e66f0989dfb2 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:54.354717 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-65653449-0bcb-444f-9437-e66f0989dfb2 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:54.355158 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-65653449-0bcb-444f-9437-e66f0989dfb2 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:54.552491 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-6dfa6a46-d21f-4f86-8664-8c2c2e733f32 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:54.569281 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-6dfa6a46-d21f-4f86-8664-8c2c2e733f32 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1502 microversion: 2.1 time: 0.519366 Nov 16 16:05:54.570242 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 154/328] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:54 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1502 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:05:54.575113 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-b247f84e-667f-49a8-9652-620638209d35 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:54.575750 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-b247f84e-667f-49a8-9652-620638209d35 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] [instance: 0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:54.588129 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b247f84e-667f-49a8-9652-620638209d35 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:54.589562 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b247f84e-667f-49a8-9652-620638209d35 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:54.593017 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b247f84e-667f-49a8-9652-620638209d35 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:54.593473 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b247f84e-667f-49a8-9652-620638209d35 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:54.681775 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-65653449-0bcb-444f-9437-e66f0989dfb2 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:54.689504 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-65653449-0bcb-444f-9437-e66f0989dfb2 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a" status: 200 len: 1267 microversion: 2.1 time: 0.356529 Nov 16 16:05:54.700473 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 175/329] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:54 2021] GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a => generated 1267 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:05:54.705354 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-8197c74b-64ca-4d07-a774-bc5dcf8fb48a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a30ec0d9-7cd8-4c6e-ab5b-649095216d59"}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:54.707165 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-8197c74b-64ca-4d07-a774-bc5dcf8fb48a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:54.714415 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8197c74b-64ca-4d07-a774-bc5dcf8fb48a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:54.714902 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8197c74b-64ca-4d07-a774-bc5dcf8fb48a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:54.715861 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8197c74b-64ca-4d07-a774-bc5dcf8fb48a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:54.716091 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8197c74b-64ca-4d07-a774-bc5dcf8fb48a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:54.745478 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-8197c74b-64ca-4d07-a774-bc5dcf8fb48a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] HTTP exception thrown: Cannot 'attach_volume' instance 69df60e2-42c9-4caa-abdc-a7ecb61d8d73 while it is in vm_state rescued Nov 16 16:05:54.746264 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-8197c74b-64ca-4d07-a774-bc5dcf8fb48a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Returning 409 to user: Cannot 'attach_volume' instance 69df60e2-42c9-4caa-abdc-a7ecb61d8d73 while it is in vm_state rescued {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:05:54.747250 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-8197c74b-64ca-4d07-a774-bc5dcf8fb48a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "POST /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.045830 Nov 16 16:05:54.748305 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 176/330] 10.222.0.46 () {60 vars in 1322 bytes} [Tue Nov 16 16:05:54 2021] POST /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73/os-volume_attachments => generated 152 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 16 16:05:54.764966 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-2cfd4dfe-9de9-4b06-945f-ad97d942d78f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:54.765581 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-2cfd4dfe-9de9-4b06-945f-ad97d942d78f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:54.772750 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2cfd4dfe-9de9-4b06-945f-ad97d942d78f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:54.773291 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2cfd4dfe-9de9-4b06-945f-ad97d942d78f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:54.774318 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2cfd4dfe-9de9-4b06-945f-ad97d942d78f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:54.774825 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2cfd4dfe-9de9-4b06-945f-ad97d942d78f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:54.858610 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-2cfd4dfe-9de9-4b06-945f-ad97d942d78f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "POST /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73/action" status: 202 len: 0 microversion: 2.1 time: 0.101017 Nov 16 16:05:54.863838 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 177/331] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:05:54 2021] POST /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:05:54.870273 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-39df7995-5ad0-424b-8649-3fdbbd6ad1c5 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:54.871788 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-39df7995-5ad0-424b-8649-3fdbbd6ad1c5 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:54.879129 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-39df7995-5ad0-424b-8649-3fdbbd6ad1c5 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:54.879807 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-39df7995-5ad0-424b-8649-3fdbbd6ad1c5 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:54.881304 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-39df7995-5ad0-424b-8649-3fdbbd6ad1c5 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:54.881834 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-39df7995-5ad0-424b-8649-3fdbbd6ad1c5 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:54.922980 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-b247f84e-667f-49a8-9652-620638209d35 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d9e7cc0fb849e8a3d067214ac3402a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e03b8724364db290573e549b643dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:54.932852 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-b247f84e-667f-49a8-9652-620638209d35 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] 10.222.0.46 "GET /compute/v2.1/servers/0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5" status: 200 len: 1313 microversion: 2.1 time: 0.361339 Nov 16 16:05:54.933745 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 155/332] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:54 2021] GET /compute/v2.1/servers/0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5 => generated 1313 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:05:55.002582 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-7d43b781-12e9-4fa1-8c57-dd731793a699 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:55.003202 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-7d43b781-12e9-4fa1-8c57-dd731793a699 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:55.011069 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7d43b781-12e9-4fa1-8c57-dd731793a699 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:55.011865 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7d43b781-12e9-4fa1-8c57-dd731793a699 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:55.012876 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7d43b781-12e9-4fa1-8c57-dd731793a699 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:55.013478 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7d43b781-12e9-4fa1-8c57-dd731793a699 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:55.258048 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-39df7995-5ad0-424b-8649-3fdbbd6ad1c5 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:55.265392 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-39df7995-5ad0-424b-8649-3fdbbd6ad1c5 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1510 microversion: 2.1 time: 0.400326 Nov 16 16:05:55.266123 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 178/333] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:54 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1510 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:05:55.325419 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-de5dcd61-6a05-4ee2-bd26-2ff421856332 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "05c92bfb-7118-48a7-bcef-4292de71a9bd"}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:05:55.327087 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-de5dcd61-6a05-4ee2-bd26-2ff421856332 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:55.333181 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-de5dcd61-6a05-4ee2-bd26-2ff421856332 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:55.333835 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-de5dcd61-6a05-4ee2-bd26-2ff421856332 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:55.334776 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-de5dcd61-6a05-4ee2-bd26-2ff421856332 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:55.335385 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-de5dcd61-6a05-4ee2-bd26-2ff421856332 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:55.382167 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-7d43b781-12e9-4fa1-8c57-dd731793a699 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:55.395206 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-7d43b781-12e9-4fa1-8c57-dd731793a699 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:55.397974 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-7d43b781-12e9-4fa1-8c57-dd731793a699 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:55.399193 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-7d43b781-12e9-4fa1-8c57-dd731793a699 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1723 microversion: 2.20 time: 0.409606 Nov 16 16:05:55.406944 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 156/334] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:05:54 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1723 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:05:55.644417 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-de5dcd61-6a05-4ee2-bd26-2ff421856332 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.324058 Nov 16 16:05:55.645545 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 179/335] 10.222.0.46 () {60 vars in 1322 bytes} [Tue Nov 16 16:05:55 2021] POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/os-volume_attachments => generated 194 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:05:55.716525 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-3776e08a-c957-4087-aca6-b2a95650d1a0 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:55.717399 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-3776e08a-c957-4087-aca6-b2a95650d1a0 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: db94bd78-8ff3-4784-84bd-e09796f6633a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:55.727998 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3776e08a-c957-4087-aca6-b2a95650d1a0 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:55.729807 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3776e08a-c957-4087-aca6-b2a95650d1a0 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:55.731883 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3776e08a-c957-4087-aca6-b2a95650d1a0 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:55.732513 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3776e08a-c957-4087-aca6-b2a95650d1a0 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:55.900615 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-3776e08a-c957-4087-aca6-b2a95650d1a0 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:55.908272 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-3776e08a-c957-4087-aca6-b2a95650d1a0 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a" status: 200 len: 1267 microversion: 2.1 time: 0.204345 Nov 16 16:05:55.908844 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 157/336] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:55 2021] GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a => generated 1267 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:05:55.952910 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b49dbf8e-5529-428c-a432-dcc531419f2a tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:55.953609 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b49dbf8e-5529-428c-a432-dcc531419f2a tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] [instance: 0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:56.102716 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b49dbf8e-5529-428c-a432-dcc531419f2a tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:56.103165 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b49dbf8e-5529-428c-a432-dcc531419f2a tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:56.103984 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b49dbf8e-5529-428c-a432-dcc531419f2a tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:56.104417 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b49dbf8e-5529-428c-a432-dcc531419f2a tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:56.246169 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b49dbf8e-5529-428c-a432-dcc531419f2a tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d9e7cc0fb849e8a3d067214ac3402a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e03b8724364db290573e549b643dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:56.255268 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b49dbf8e-5529-428c-a432-dcc531419f2a tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] 10.222.0.46 "GET /compute/v2.1/servers/0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5" status: 200 len: 1498 microversion: 2.1 time: 0.306794 Nov 16 16:05:56.267111 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 180/337] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:55 2021] GET /compute/v2.1/servers/0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5 => generated 1498 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:05:56.283912 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-cb4acee0-dd80-43d5-8636-1211be53e986 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:56.284590 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-cb4acee0-dd80-43d5-8636-1211be53e986 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:56.290710 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cb4acee0-dd80-43d5-8636-1211be53e986 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:56.291159 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cb4acee0-dd80-43d5-8636-1211be53e986 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:56.292174 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cb4acee0-dd80-43d5-8636-1211be53e986 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:56.292616 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cb4acee0-dd80-43d5-8636-1211be53e986 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:56.418581 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-878227df-dc57-4245-b2c3-e1cd801da820 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:56.419211 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-878227df-dc57-4245-b2c3-e1cd801da820 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:56.428693 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-878227df-dc57-4245-b2c3-e1cd801da820 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:56.429106 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-878227df-dc57-4245-b2c3-e1cd801da820 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:56.430081 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-878227df-dc57-4245-b2c3-e1cd801da820 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:56.430702 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-878227df-dc57-4245-b2c3-e1cd801da820 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:56.435383 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-cb4acee0-dd80-43d5-8636-1211be53e986 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:56.444990 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-cb4acee0-dd80-43d5-8636-1211be53e986 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1510 microversion: 2.1 time: 0.164515 Nov 16 16:05:56.446193 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 158/338] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:56 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:05:56.593135 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-878227df-dc57-4245-b2c3-e1cd801da820 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:56.602033 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-878227df-dc57-4245-b2c3-e1cd801da820 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:56.603538 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-878227df-dc57-4245-b2c3-e1cd801da820 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:56.604687 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-878227df-dc57-4245-b2c3-e1cd801da820 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1723 microversion: 2.20 time: 0.190470 Nov 16 16:05:56.605240 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 181/339] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:05:56 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:05:56.786649 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-9bb64a1a-acb2-4c65-9c6f-8bdc6f80ca60 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:56.787195 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-9bb64a1a-acb2-4c65-9c6f-8bdc6f80ca60 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] [instance: 0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:56.793233 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9bb64a1a-acb2-4c65-9c6f-8bdc6f80ca60 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:56.793681 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9bb64a1a-acb2-4c65-9c6f-8bdc6f80ca60 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:56.794469 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9bb64a1a-acb2-4c65-9c6f-8bdc6f80ca60 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:56.794907 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9bb64a1a-acb2-4c65-9c6f-8bdc6f80ca60 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:56.821283 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-9bb64a1a-acb2-4c65-9c6f-8bdc6f80ca60 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] [instance: 0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5] Going to try to terminate instance {{(pid=116085) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 16:05:56.911240 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-9bb64a1a-acb2-4c65-9c6f-8bdc6f80ca60 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5" status: 204 len: 0 microversion: 2.1 time: 0.129020 Nov 16 16:05:56.911943 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 159/340] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 16 16:05:56 2021] DELETE /compute/v2.1/servers/0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 16:05:56.921804 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c398eabb-f064-4a94-a792-d761874353e2 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:56.922760 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c398eabb-f064-4a94-a792-d761874353e2 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] [instance: 0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:56.928568 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-f3ac62cf-7ca9-4e3f-bc44-7ecc837cefcf tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:56.929330 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-f3ac62cf-7ca9-4e3f-bc44-7ecc837cefcf tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: db94bd78-8ff3-4784-84bd-e09796f6633a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:56.930614 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c398eabb-f064-4a94-a792-d761874353e2 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:56.931271 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c398eabb-f064-4a94-a792-d761874353e2 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:56.932297 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c398eabb-f064-4a94-a792-d761874353e2 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:56.932960 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c398eabb-f064-4a94-a792-d761874353e2 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:56.937048 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f3ac62cf-7ca9-4e3f-bc44-7ecc837cefcf tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:56.937552 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f3ac62cf-7ca9-4e3f-bc44-7ecc837cefcf tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:56.938486 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f3ac62cf-7ca9-4e3f-bc44-7ecc837cefcf tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:56.938927 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f3ac62cf-7ca9-4e3f-bc44-7ecc837cefcf tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:57.145914 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-c398eabb-f064-4a94-a792-d761874353e2 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d9e7cc0fb849e8a3d067214ac3402a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e03b8724364db290573e549b643dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:57.153658 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c398eabb-f064-4a94-a792-d761874353e2 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] 10.222.0.46 "GET /compute/v2.1/servers/0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5" status: 200 len: 1504 microversion: 2.1 time: 0.235636 Nov 16 16:05:57.154425 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 182/341] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:56 2021] GET /compute/v2.1/servers/0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5 => generated 1504 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:05:57.154928 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-f3ac62cf-7ca9-4e3f-bc44-7ecc837cefcf tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:57.162697 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-f3ac62cf-7ca9-4e3f-bc44-7ecc837cefcf tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a" status: 200 len: 1267 microversion: 2.1 time: 0.240178 Nov 16 16:05:57.163496 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 160/342] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:56 2021] GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a => generated 1267 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:05:57.462699 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ab34efdc-4f23-41a5-bc3b-e27fb0718319 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:57.463301 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ab34efdc-4f23-41a5-bc3b-e27fb0718319 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:57.469196 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ab34efdc-4f23-41a5-bc3b-e27fb0718319 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:57.469639 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ab34efdc-4f23-41a5-bc3b-e27fb0718319 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:57.470400 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ab34efdc-4f23-41a5-bc3b-e27fb0718319 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:57.470833 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ab34efdc-4f23-41a5-bc3b-e27fb0718319 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:57.605135 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ab34efdc-4f23-41a5-bc3b-e27fb0718319 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:57.612460 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ab34efdc-4f23-41a5-bc3b-e27fb0718319 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1510 microversion: 2.1 time: 0.153411 Nov 16 16:05:57.613735 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 183/343] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:57 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:05:57.622807 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-e0c6a006-2b16-41e9-91ab-c7572826834a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:57.623446 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-e0c6a006-2b16-41e9-91ab-c7572826834a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:57.629291 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e0c6a006-2b16-41e9-91ab-c7572826834a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:57.629732 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e0c6a006-2b16-41e9-91ab-c7572826834a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:57.630508 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e0c6a006-2b16-41e9-91ab-c7572826834a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:57.630943 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e0c6a006-2b16-41e9-91ab-c7572826834a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:57.760073 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-e0c6a006-2b16-41e9-91ab-c7572826834a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:57.767756 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-e0c6a006-2b16-41e9-91ab-c7572826834a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:57.769812 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-e0c6a006-2b16-41e9-91ab-c7572826834a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:57.771016 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-e0c6a006-2b16-41e9-91ab-c7572826834a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1723 microversion: 2.20 time: 0.151982 Nov 16 16:05:57.771591 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 161/344] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:05:57 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:05:58.171396 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3eb1ce39-1943-4bd5-bade-94496beb6636 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:58.172469 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-3eb1ce39-1943-4bd5-bade-94496beb6636 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] [instance: 0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:58.180116 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-2bfecf7c-6de8-4d72-94e1-47f63365fcbe tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:58.180625 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3eb1ce39-1943-4bd5-bade-94496beb6636 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:58.180625 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3eb1ce39-1943-4bd5-bade-94496beb6636 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:58.181526 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-2bfecf7c-6de8-4d72-94e1-47f63365fcbe tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: db94bd78-8ff3-4784-84bd-e09796f6633a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:58.182008 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3eb1ce39-1943-4bd5-bade-94496beb6636 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:58.182562 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3eb1ce39-1943-4bd5-bade-94496beb6636 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:58.200441 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2bfecf7c-6de8-4d72-94e1-47f63365fcbe tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:58.201266 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2bfecf7c-6de8-4d72-94e1-47f63365fcbe tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:58.202131 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2bfecf7c-6de8-4d72-94e1-47f63365fcbe tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:58.202684 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2bfecf7c-6de8-4d72-94e1-47f63365fcbe tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:58.409461 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-3eb1ce39-1943-4bd5-bade-94496beb6636 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d9e7cc0fb849e8a3d067214ac3402a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e03b8724364db290573e549b643dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:58.414179 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-2bfecf7c-6de8-4d72-94e1-47f63365fcbe tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:58.416819 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-3eb1ce39-1943-4bd5-bade-94496beb6636 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] 10.222.0.46 "GET /compute/v2.1/servers/0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5" status: 200 len: 1504 microversion: 2.1 time: 0.249300 Nov 16 16:05:58.417385 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 184/345] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:58 2021] GET /compute/v2.1/servers/0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5 => generated 1504 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:05:58.421577 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-2bfecf7c-6de8-4d72-94e1-47f63365fcbe tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a" status: 200 len: 1267 microversion: 2.1 time: 0.245588 Nov 16 16:05:58.422146 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 162/346] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:58 2021] GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a => generated 1267 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:05:58.630724 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-994dbfac-6bf6-48e4-89c9-1a7e7aaa9bd2 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:58.631268 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-994dbfac-6bf6-48e4-89c9-1a7e7aaa9bd2 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:58.637276 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-994dbfac-6bf6-48e4-89c9-1a7e7aaa9bd2 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:58.637722 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-994dbfac-6bf6-48e4-89c9-1a7e7aaa9bd2 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:58.638495 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-994dbfac-6bf6-48e4-89c9-1a7e7aaa9bd2 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:58.638932 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-994dbfac-6bf6-48e4-89c9-1a7e7aaa9bd2 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:58.775041 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-994dbfac-6bf6-48e4-89c9-1a7e7aaa9bd2 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:58.782458 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-994dbfac-6bf6-48e4-89c9-1a7e7aaa9bd2 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1516 microversion: 2.1 time: 0.156203 Nov 16 16:05:58.783251 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 185/347] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:58 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:05:58.793440 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-ce745b10-cdce-4413-bb0e-4282cfff0391 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:58.794124 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-ce745b10-cdce-4413-bb0e-4282cfff0391 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:58.799700 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ce745b10-cdce-4413-bb0e-4282cfff0391 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:58.800751 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ce745b10-cdce-4413-bb0e-4282cfff0391 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:58.801633 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ce745b10-cdce-4413-bb0e-4282cfff0391 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:58.802069 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ce745b10-cdce-4413-bb0e-4282cfff0391 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:58.942838 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-ce745b10-cdce-4413-bb0e-4282cfff0391 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:58.950544 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-ce745b10-cdce-4413-bb0e-4282cfff0391 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:58.952058 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-ce745b10-cdce-4413-bb0e-4282cfff0391 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:58.953198 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-ce745b10-cdce-4413-bb0e-4282cfff0391 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1723 microversion: 2.20 time: 0.163761 Nov 16 16:05:58.953747 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 163/348] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:05:58 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:05:59.433854 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1fadfd3f-960e-4364-9c20-8185091dc172 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:59.434458 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1fadfd3f-960e-4364-9c20-8185091dc172 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] [instance: 0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:59.437758 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-ff910bbe-498e-4af9-8919-7693b1731884 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:59.438365 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-ff910bbe-498e-4af9-8919-7693b1731884 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: db94bd78-8ff3-4784-84bd-e09796f6633a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:59.441889 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1fadfd3f-960e-4364-9c20-8185091dc172 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:59.442532 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1fadfd3f-960e-4364-9c20-8185091dc172 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:59.443316 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1fadfd3f-960e-4364-9c20-8185091dc172 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:59.443773 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1fadfd3f-960e-4364-9c20-8185091dc172 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:59.445839 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ff910bbe-498e-4af9-8919-7693b1731884 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:59.446344 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ff910bbe-498e-4af9-8919-7693b1731884 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:59.447263 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ff910bbe-498e-4af9-8919-7693b1731884 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:59.447726 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ff910bbe-498e-4af9-8919-7693b1731884 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:59.643877 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-ff910bbe-498e-4af9-8919-7693b1731884 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:59.647919 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1fadfd3f-960e-4364-9c20-8185091dc172 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d9e7cc0fb849e8a3d067214ac3402a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e03b8724364db290573e549b643dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:05:59.651344 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-ff910bbe-498e-4af9-8919-7693b1731884 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a" status: 200 len: 1267 microversion: 2.1 time: 0.217097 Nov 16 16:05:59.651952 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 164/349] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:59 2021] GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a => generated 1267 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:05:59.655601 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1fadfd3f-960e-4364-9c20-8185091dc172 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] 10.222.0.46 "GET /compute/v2.1/servers/0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5" status: 200 len: 1504 microversion: 2.1 time: 0.225342 Nov 16 16:05:59.656149 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 186/350] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:05:59 2021] GET /compute/v2.1/servers/0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5 => generated 1504 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:05:59.971243 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-4dd710e2-19b1-4323-a89b-e021d0e945cf tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:05:59.971870 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-4dd710e2-19b1-4323-a89b-e021d0e945cf tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:05:59.977739 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4dd710e2-19b1-4323-a89b-e021d0e945cf tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:59.978180 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4dd710e2-19b1-4323-a89b-e021d0e945cf tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:05:59.978950 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4dd710e2-19b1-4323-a89b-e021d0e945cf tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:05:59.979384 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4dd710e2-19b1-4323-a89b-e021d0e945cf tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:00.110502 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-4dd710e2-19b1-4323-a89b-e021d0e945cf tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:00.118791 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-4dd710e2-19b1-4323-a89b-e021d0e945cf tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:00.120318 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-4dd710e2-19b1-4323-a89b-e021d0e945cf tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:00.121460 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-4dd710e2-19b1-4323-a89b-e021d0e945cf tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1723 microversion: 2.20 time: 0.153920 Nov 16 16:06:00.122013 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 165/351] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:05:59 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:06:00.668921 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d77bb7f8-1f8f-4081-9633-b58906bd6d32 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:00.669539 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d77bb7f8-1f8f-4081-9633-b58906bd6d32 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: db94bd78-8ff3-4784-84bd-e09796f6633a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:00.672973 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-e5ab8267-2207-4266-a44a-a7e08c448939 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:00.673583 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-e5ab8267-2207-4266-a44a-a7e08c448939 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] [instance: 0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:00.675913 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d77bb7f8-1f8f-4081-9633-b58906bd6d32 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:00.676368 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d77bb7f8-1f8f-4081-9633-b58906bd6d32 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:00.677160 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d77bb7f8-1f8f-4081-9633-b58906bd6d32 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:00.677598 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d77bb7f8-1f8f-4081-9633-b58906bd6d32 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:00.680436 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e5ab8267-2207-4266-a44a-a7e08c448939 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:00.680901 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e5ab8267-2207-4266-a44a-a7e08c448939 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:00.681675 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e5ab8267-2207-4266-a44a-a7e08c448939 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:00.682109 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e5ab8267-2207-4266-a44a-a7e08c448939 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:00.878060 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d77bb7f8-1f8f-4081-9633-b58906bd6d32 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:00.882500 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-e5ab8267-2207-4266-a44a-a7e08c448939 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d9e7cc0fb849e8a3d067214ac3402a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e03b8724364db290573e549b643dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:00.886560 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d77bb7f8-1f8f-4081-9633-b58906bd6d32 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a" status: 200 len: 1267 microversion: 2.1 time: 0.221324 Nov 16 16:06:00.887135 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 187/352] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:00 2021] GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a => generated 1267 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:00.889668 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-e5ab8267-2207-4266-a44a-a7e08c448939 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] 10.222.0.46 "GET /compute/v2.1/servers/0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5" status: 200 len: 1504 microversion: 2.1 time: 0.220212 Nov 16 16:06:00.890220 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 166/353] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:00 2021] GET /compute/v2.1/servers/0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5 => generated 1504 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:06:01.140593 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e1829ae2-44ab-4400-871c-fceaa1c9cfcb tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:01.141609 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e1829ae2-44ab-4400-871c-fceaa1c9cfcb tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:01.148869 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e1829ae2-44ab-4400-871c-fceaa1c9cfcb tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:01.149324 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e1829ae2-44ab-4400-871c-fceaa1c9cfcb tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:01.150298 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e1829ae2-44ab-4400-871c-fceaa1c9cfcb tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:01.150741 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e1829ae2-44ab-4400-871c-fceaa1c9cfcb tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:01.279248 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e1829ae2-44ab-4400-871c-fceaa1c9cfcb tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:01.287762 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e1829ae2-44ab-4400-871c-fceaa1c9cfcb tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:01.289251 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e1829ae2-44ab-4400-871c-fceaa1c9cfcb tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:01.290404 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e1829ae2-44ab-4400-871c-fceaa1c9cfcb tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1723 microversion: 2.20 time: 0.153438 Nov 16 16:06:01.290950 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 188/354] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:06:01 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:06:01.903660 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-01541236-7aa4-4813-86dc-00ac9af95183 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:01.904383 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-01541236-7aa4-4813-86dc-00ac9af95183 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: db94bd78-8ff3-4784-84bd-e09796f6633a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:01.907254 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a0d70a6e-e79d-4486-976c-d9620af75d90 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:01.909118 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-a0d70a6e-e79d-4486-976c-d9620af75d90 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] [instance: 0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:01.911950 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-01541236-7aa4-4813-86dc-00ac9af95183 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:01.912404 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-01541236-7aa4-4813-86dc-00ac9af95183 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:01.913191 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-01541236-7aa4-4813-86dc-00ac9af95183 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:01.913623 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-01541236-7aa4-4813-86dc-00ac9af95183 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:01.918420 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a0d70a6e-e79d-4486-976c-d9620af75d90 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:01.919083 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a0d70a6e-e79d-4486-976c-d9620af75d90 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:01.920159 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a0d70a6e-e79d-4486-976c-d9620af75d90 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:01.920803 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a0d70a6e-e79d-4486-976c-d9620af75d90 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:02.250159 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-01541236-7aa4-4813-86dc-00ac9af95183 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:02.258024 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-01541236-7aa4-4813-86dc-00ac9af95183 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a" status: 200 len: 1267 microversion: 2.1 time: 0.358134 Nov 16 16:06:02.258456 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 167/355] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:01 2021] GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a => generated 1267 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:02.262933 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-2ae6238b-ec5c-4b0d-8365-8f1c1d02bdc4 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:02.263568 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-2ae6238b-ec5c-4b0d-8365-8f1c1d02bdc4 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:02.270197 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2ae6238b-ec5c-4b0d-8365-8f1c1d02bdc4 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:02.270651 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2ae6238b-ec5c-4b0d-8365-8f1c1d02bdc4 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:02.271678 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2ae6238b-ec5c-4b0d-8365-8f1c1d02bdc4 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:02.272113 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2ae6238b-ec5c-4b0d-8365-8f1c1d02bdc4 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:02.307161 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-a0d70a6e-e79d-4486-976c-d9620af75d90 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d9e7cc0fb849e8a3d067214ac3402a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e03b8724364db290573e549b643dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:02.317439 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-a0d70a6e-e79d-4486-976c-d9620af75d90 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] 10.222.0.46 "GET /compute/v2.1/servers/0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5" status: 200 len: 1504 microversion: 2.1 time: 0.412947 Nov 16 16:06:02.318401 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 189/356] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:01 2021] GET /compute/v2.1/servers/0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5 => generated 1504 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:06:02.330018 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d9b50260-56ce-422d-97da-e8cc65282075 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:02.330629 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d9b50260-56ce-422d-97da-e8cc65282075 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:02.340451 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d9b50260-56ce-422d-97da-e8cc65282075 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:02.340954 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d9b50260-56ce-422d-97da-e8cc65282075 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:02.341698 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d9b50260-56ce-422d-97da-e8cc65282075 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:02.342131 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d9b50260-56ce-422d-97da-e8cc65282075 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:02.837694 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-2ae6238b-ec5c-4b0d-8365-8f1c1d02bdc4 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:02.846119 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-2ae6238b-ec5c-4b0d-8365-8f1c1d02bdc4 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1516 microversion: 2.1 time: 0.586459 Nov 16 16:06:02.846819 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 168/357] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:02 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1516 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:02.862962 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-85f62ef0-9971-4775-b74e-368b34df3a2c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "30eee39f-3c0b-4550-9514-218633e38054"}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:06:02.865081 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-85f62ef0-9971-4775-b74e-368b34df3a2c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:02.870779 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-85f62ef0-9971-4775-b74e-368b34df3a2c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:02.871221 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-85f62ef0-9971-4775-b74e-368b34df3a2c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:02.872107 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-85f62ef0-9971-4775-b74e-368b34df3a2c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:02.872582 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-85f62ef0-9971-4775-b74e-368b34df3a2c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:02.881369 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d9b50260-56ce-422d-97da-e8cc65282075 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:02.892185 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d9b50260-56ce-422d-97da-e8cc65282075 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:02.893766 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d9b50260-56ce-422d-97da-e8cc65282075 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:02.895167 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d9b50260-56ce-422d-97da-e8cc65282075 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1723 microversion: 2.20 time: 0.568917 Nov 16 16:06:02.896104 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 190/358] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:06:02 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1723 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:06:03.063073 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-ea50fc4b-9914-4df7-aa41-c8f81857a713 req-3f682763-bbfd-47d7-b64c-669551be120f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5", "name": "network-vif-deleted", "tag": "406850df-9b38-43ec-be90-cae97c408b1b"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:06:03.064693 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:06:03.064693 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Nov 16 16:06:03.072345 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-ea50fc4b-9914-4df7-aa41-c8f81857a713 req-3f682763-bbfd-47d7-b64c-669551be120f service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:03.072784 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-ea50fc4b-9914-4df7-aa41-c8f81857a713 req-3f682763-bbfd-47d7-b64c-669551be120f service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:03.084179 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-ea50fc4b-9914-4df7-aa41-c8f81857a713 req-3f682763-bbfd-47d7-b64c-669551be120f service nova] Creating event network-vif-deleted:406850df-9b38-43ec-be90-cae97c408b1b for instance 0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5 on hv-cinder-81809 Nov 16 16:06:03.089350 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-ea50fc4b-9914-4df7-aa41-c8f81857a713 req-3f682763-bbfd-47d7-b64c-669551be120f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030121 Nov 16 16:06:03.089940 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 191/359] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:06:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:06:03.189257 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-df8e2f0d-394a-468b-8f49-a8331ecdc697 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:06:03.195332 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-df8e2f0d-394a-468b-8f49-a8331ecdc697 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:03.195825 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-df8e2f0d-394a-468b-8f49-a8331ecdc697 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:03.256107 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-df8e2f0d-394a-468b-8f49-a8331ecdc697 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Going to try to stop instance {{(pid=116084) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 16 16:06:03.301531 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-df8e2f0d-394a-468b-8f49-a8331ecdc697 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action" status: 202 len: 0 microversion: 2.1 time: 0.116142 Nov 16 16:06:03.302130 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 192/360] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:06:03 2021] POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 16 16:06:03.306973 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-4a1a40ad-6bed-4ab4-89e2-c95370c5bfdc tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:03.307706 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-4a1a40ad-6bed-4ab4-89e2-c95370c5bfdc tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: db94bd78-8ff3-4784-84bd-e09796f6633a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:03.313612 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4a1a40ad-6bed-4ab4-89e2-c95370c5bfdc tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:03.314065 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4a1a40ad-6bed-4ab4-89e2-c95370c5bfdc tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:03.314890 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4a1a40ad-6bed-4ab4-89e2-c95370c5bfdc tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:03.315277 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4a1a40ad-6bed-4ab4-89e2-c95370c5bfdc tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:03.455142 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-4a1a40ad-6bed-4ab4-89e2-c95370c5bfdc tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:03.463592 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-4a1a40ad-6bed-4ab4-89e2-c95370c5bfdc tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a" status: 200 len: 1267 microversion: 2.1 time: 0.160314 Nov 16 16:06:03.464155 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 193/361] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:03 2021] GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:03.468240 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-923ef0fd-d2ca-4dcb-80e9-b5afe1faa00f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:03.468832 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-923ef0fd-d2ca-4dcb-80e9-b5afe1faa00f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:03.474652 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-923ef0fd-d2ca-4dcb-80e9-b5afe1faa00f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:03.475105 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-923ef0fd-d2ca-4dcb-80e9-b5afe1faa00f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:03.475902 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-923ef0fd-d2ca-4dcb-80e9-b5afe1faa00f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:03.476332 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-923ef0fd-d2ca-4dcb-80e9-b5afe1faa00f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:03.605069 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-923ef0fd-d2ca-4dcb-80e9-b5afe1faa00f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:03.613448 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-923ef0fd-d2ca-4dcb-80e9-b5afe1faa00f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1720 microversion: 2.1 time: 0.148045 Nov 16 16:06:03.613448 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 194/362] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:03 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1720 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:03.618286 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-8c119799-6d79-496c-867e-9a356579273c tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:03.618889 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-8c119799-6d79-496c-867e-9a356579273c tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] [instance: 0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:03.625758 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8c119799-6d79-496c-867e-9a356579273c tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:03.626572 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8c119799-6d79-496c-867e-9a356579273c tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:03.627943 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8c119799-6d79-496c-867e-9a356579273c tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:03.628392 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8c119799-6d79-496c-867e-9a356579273c tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:03.689789 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-8c119799-6d79-496c-867e-9a356579273c tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d9e7cc0fb849e8a3d067214ac3402a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e03b8724364db290573e549b643dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:03.698030 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-8c119799-6d79-496c-867e-9a356579273c tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] 10.222.0.46 "GET /compute/v2.1/servers/0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5" status: 200 len: 1462 microversion: 2.1 time: 0.083116 Nov 16 16:06:03.698589 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 195/363] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:03 2021] GET /compute/v2.1/servers/0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5 => generated 1462 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:03.926455 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f4368907-3d70-402d-968f-00821cbe6ff9 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:03.927009 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f4368907-3d70-402d-968f-00821cbe6ff9 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:03.932951 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f4368907-3d70-402d-968f-00821cbe6ff9 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:03.933403 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f4368907-3d70-402d-968f-00821cbe6ff9 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:03.934180 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f4368907-3d70-402d-968f-00821cbe6ff9 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:03.934620 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f4368907-3d70-402d-968f-00821cbe6ff9 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:04.071749 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f4368907-3d70-402d-968f-00821cbe6ff9 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:04.079346 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f4368907-3d70-402d-968f-00821cbe6ff9 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:04.080868 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f4368907-3d70-402d-968f-00821cbe6ff9 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:04.082459 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f4368907-3d70-402d-968f-00821cbe6ff9 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1723 microversion: 2.20 time: 0.159938 Nov 16 16:06:04.083112 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 196/364] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:06:03 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:06:04.480493 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1a14533d-d706-4b22-91f2-33903f97aca7 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:04.481054 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1a14533d-d706-4b22-91f2-33903f97aca7 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: db94bd78-8ff3-4784-84bd-e09796f6633a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:04.486836 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1a14533d-d706-4b22-91f2-33903f97aca7 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:04.487278 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1a14533d-d706-4b22-91f2-33903f97aca7 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:04.488813 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1a14533d-d706-4b22-91f2-33903f97aca7 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:04.489576 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1a14533d-d706-4b22-91f2-33903f97aca7 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:04.621232 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1a14533d-d706-4b22-91f2-33903f97aca7 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:04.628485 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1a14533d-d706-4b22-91f2-33903f97aca7 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a" status: 200 len: 1267 microversion: 2.1 time: 0.151686 Nov 16 16:06:04.629639 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 197/365] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:04 2021] GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:06:04.633867 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-225ff778-9062-48f6-a3fa-6a7beb785deb tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:04.634467 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-225ff778-9062-48f6-a3fa-6a7beb785deb tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:04.640067 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-225ff778-9062-48f6-a3fa-6a7beb785deb tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:04.640515 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-225ff778-9062-48f6-a3fa-6a7beb785deb tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:04.641283 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-225ff778-9062-48f6-a3fa-6a7beb785deb tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:04.641716 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-225ff778-9062-48f6-a3fa-6a7beb785deb tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:04.774013 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-225ff778-9062-48f6-a3fa-6a7beb785deb tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:04.783202 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-225ff778-9062-48f6-a3fa-6a7beb785deb tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1720 microversion: 2.1 time: 0.152634 Nov 16 16:06:04.783794 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 198/366] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:04 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:04.788924 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e3689ce8-b586-4d94-be84-54345b131f17 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:04.789518 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e3689ce8-b586-4d94-be84-54345b131f17 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] [instance: 0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:04.795364 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e3689ce8-b586-4d94-be84-54345b131f17 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:04.795851 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e3689ce8-b586-4d94-be84-54345b131f17 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:04.796620 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e3689ce8-b586-4d94-be84-54345b131f17 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:04.797050 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e3689ce8-b586-4d94-be84-54345b131f17 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:04.856684 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e3689ce8-b586-4d94-be84-54345b131f17 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d9e7cc0fb849e8a3d067214ac3402a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e03b8724364db290573e549b643dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:04.864481 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e3689ce8-b586-4d94-be84-54345b131f17 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] 10.222.0.46 "GET /compute/v2.1/servers/0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5" status: 200 len: 1462 microversion: 2.1 time: 0.079699 Nov 16 16:06:04.865043 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 199/367] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:04 2021] GET /compute/v2.1/servers/0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5 => generated 1462 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:05.101106 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c744ead0-0024-4bf3-b827-694c20d7d0df tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:05.101780 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c744ead0-0024-4bf3-b827-694c20d7d0df tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:05.108024 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c744ead0-0024-4bf3-b827-694c20d7d0df tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:05.108469 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c744ead0-0024-4bf3-b827-694c20d7d0df tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:05.109238 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c744ead0-0024-4bf3-b827-694c20d7d0df tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:05.109671 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c744ead0-0024-4bf3-b827-694c20d7d0df tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:05.241218 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-c744ead0-0024-4bf3-b827-694c20d7d0df tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:05.249468 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-c744ead0-0024-4bf3-b827-694c20d7d0df tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:05.250968 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-c744ead0-0024-4bf3-b827-694c20d7d0df tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:05.252169 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c744ead0-0024-4bf3-b827-694c20d7d0df tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1723 microversion: 2.20 time: 0.155317 Nov 16 16:06:05.252731 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 200/368] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:06:05 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:06:05.645521 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-12f49e18-eba6-4503-a24b-2a8db61ee98c tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:05.646125 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-12f49e18-eba6-4503-a24b-2a8db61ee98c tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: db94bd78-8ff3-4784-84bd-e09796f6633a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:05.651985 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-12f49e18-eba6-4503-a24b-2a8db61ee98c tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:05.652687 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-12f49e18-eba6-4503-a24b-2a8db61ee98c tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:05.653506 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-12f49e18-eba6-4503-a24b-2a8db61ee98c tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:05.653867 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-12f49e18-eba6-4503-a24b-2a8db61ee98c tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:05.796832 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-12f49e18-eba6-4503-a24b-2a8db61ee98c tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:05.810407 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-12f49e18-eba6-4503-a24b-2a8db61ee98c tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a" status: 200 len: 1267 microversion: 2.1 time: 0.169127 Nov 16 16:06:05.814029 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 201/369] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:05 2021] GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:06:05.819395 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-550c8b78-ece2-4d34-9ec0-093617bbdfaa tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:05.820050 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-550c8b78-ece2-4d34-9ec0-093617bbdfaa tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:05.826380 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-550c8b78-ece2-4d34-9ec0-093617bbdfaa tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:05.826855 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-550c8b78-ece2-4d34-9ec0-093617bbdfaa tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:05.827683 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-550c8b78-ece2-4d34-9ec0-093617bbdfaa tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:05.828120 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-550c8b78-ece2-4d34-9ec0-093617bbdfaa tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:05.992987 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-550c8b78-ece2-4d34-9ec0-093617bbdfaa tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:06.002915 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-550c8b78-ece2-4d34-9ec0-093617bbdfaa tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1720 microversion: 2.1 time: 0.187835 Nov 16 16:06:06.003510 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 202/370] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:05 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1720 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:06.008677 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c63153dc-d389-46aa-bec1-3f60005db1b7 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:06.009286 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c63153dc-d389-46aa-bec1-3f60005db1b7 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] [instance: 0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:06.016031 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c63153dc-d389-46aa-bec1-3f60005db1b7 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:06.016477 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c63153dc-d389-46aa-bec1-3f60005db1b7 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:06.017268 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c63153dc-d389-46aa-bec1-3f60005db1b7 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:06.017706 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c63153dc-d389-46aa-bec1-3f60005db1b7 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:06.063221 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c63153dc-d389-46aa-bec1-3f60005db1b7 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:06.063898 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c63153dc-d389-46aa-bec1-3f60005db1b7 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:06.065528 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.objects.instance [None req-c63153dc-d389-46aa-bec1-3f60005db1b7 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lazy-loading 'fault' on Instance uuid 0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5 {{(pid=116084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:06:06.108634 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-85f62ef0-9971-4775-b74e-368b34df3a2c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "POST /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.249321 Nov 16 16:06:06.110295 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 169/371] 10.222.0.46 () {60 vars in 1322 bytes} [Tue Nov 16 16:06:02 2021] POST /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73/os-volume_attachments => generated 194 bytes in 3252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:06:06.111105 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-c63153dc-d389-46aa-bec1-3f60005db1b7 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d9e7cc0fb849e8a3d067214ac3402a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e03b8724364db290573e549b643dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:06.121357 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c63153dc-d389-46aa-bec1-3f60005db1b7 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] 10.222.0.46 "GET /compute/v2.1/servers/0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5" status: 200 len: 1303 microversion: 2.1 time: 0.115637 Nov 16 16:06:06.127611 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 203/372] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:06 2021] GET /compute/v2.1/servers/0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5 => generated 1303 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:06.272530 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-33454828-44d1-4102-ad60-ea3ccf3173d1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:06.273223 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-33454828-44d1-4102-ad60-ea3ccf3173d1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:06.279843 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-33454828-44d1-4102-ad60-ea3ccf3173d1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:06.279969 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-33454828-44d1-4102-ad60-ea3ccf3173d1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:06.280740 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-33454828-44d1-4102-ad60-ea3ccf3173d1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:06.281177 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-33454828-44d1-4102-ad60-ea3ccf3173d1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:06.419432 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-33454828-44d1-4102-ad60-ea3ccf3173d1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:06.427485 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-33454828-44d1-4102-ad60-ea3ccf3173d1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:06.428979 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-33454828-44d1-4102-ad60-ea3ccf3173d1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:06.430123 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-33454828-44d1-4102-ad60-ea3ccf3173d1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1723 microversion: 2.20 time: 0.162630 Nov 16 16:06:06.430680 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 170/373] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:06:06 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:06:06.827194 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-17af8dcc-5d05-4bc3-9eef-9d848faa8ae4 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:06.827839 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-17af8dcc-5d05-4bc3-9eef-9d848faa8ae4 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: db94bd78-8ff3-4784-84bd-e09796f6633a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:06.833869 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-17af8dcc-5d05-4bc3-9eef-9d848faa8ae4 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:06.834315 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-17af8dcc-5d05-4bc3-9eef-9d848faa8ae4 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:06.835087 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-17af8dcc-5d05-4bc3-9eef-9d848faa8ae4 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:06.835550 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-17af8dcc-5d05-4bc3-9eef-9d848faa8ae4 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:06.978939 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-17af8dcc-5d05-4bc3-9eef-9d848faa8ae4 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:06.986261 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-17af8dcc-5d05-4bc3-9eef-9d848faa8ae4 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a" status: 200 len: 1267 microversion: 2.1 time: 0.162678 Nov 16 16:06:06.986835 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 204/374] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:06 2021] GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:07.019951 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-291a06f3-24f8-45f4-be1f-4cf72a31899e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:07.020570 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-291a06f3-24f8-45f4-be1f-4cf72a31899e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:07.026783 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-291a06f3-24f8-45f4-be1f-4cf72a31899e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:07.027503 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-291a06f3-24f8-45f4-be1f-4cf72a31899e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:07.028280 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-291a06f3-24f8-45f4-be1f-4cf72a31899e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:07.028718 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-291a06f3-24f8-45f4-be1f-4cf72a31899e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:07.139434 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d1fd3295-26f2-4ee7-80cf-7242b5c184de tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:07.140164 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d1fd3295-26f2-4ee7-80cf-7242b5c184de tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] [instance: 0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:07.147150 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d1fd3295-26f2-4ee7-80cf-7242b5c184de tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:07.147714 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d1fd3295-26f2-4ee7-80cf-7242b5c184de tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:07.148558 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d1fd3295-26f2-4ee7-80cf-7242b5c184de tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:07.149057 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d1fd3295-26f2-4ee7-80cf-7242b5c184de tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:07.158406 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-291a06f3-24f8-45f4-be1f-4cf72a31899e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:07.167063 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-291a06f3-24f8-45f4-be1f-4cf72a31899e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1720 microversion: 2.1 time: 0.150908 Nov 16 16:06:07.167668 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 171/375] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:07 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:07.181151 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d1fd3295-26f2-4ee7-80cf-7242b5c184de tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:07.181602 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d1fd3295-26f2-4ee7-80cf-7242b5c184de tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:07.182050 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.objects.instance [None req-d1fd3295-26f2-4ee7-80cf-7242b5c184de tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lazy-loading 'fault' on Instance uuid 0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5 {{(pid=116084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:06:07.224223 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d1fd3295-26f2-4ee7-80cf-7242b5c184de tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d9e7cc0fb849e8a3d067214ac3402a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e03b8724364db290573e549b643dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:07.231371 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d1fd3295-26f2-4ee7-80cf-7242b5c184de tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] 10.222.0.46 "GET /compute/v2.1/servers/0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5" status: 200 len: 1303 microversion: 2.1 time: 0.095795 Nov 16 16:06:07.231960 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 205/376] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:07 2021] GET /compute/v2.1/servers/0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5 => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:06:07.448724 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-7e77e673-e499-43be-a781-bf39ac816c87 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:07.449295 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-7e77e673-e499-43be-a781-bf39ac816c87 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:07.455530 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7e77e673-e499-43be-a781-bf39ac816c87 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:07.456090 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7e77e673-e499-43be-a781-bf39ac816c87 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:07.457515 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7e77e673-e499-43be-a781-bf39ac816c87 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:07.457949 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7e77e673-e499-43be-a781-bf39ac816c87 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:07.586237 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-7e77e673-e499-43be-a781-bf39ac816c87 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:07.593906 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-7e77e673-e499-43be-a781-bf39ac816c87 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:07.595398 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-7e77e673-e499-43be-a781-bf39ac816c87 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:07.596576 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-7e77e673-e499-43be-a781-bf39ac816c87 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1723 microversion: 2.20 time: 0.152389 Nov 16 16:06:07.597136 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 172/377] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:06:07 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:06:08.005513 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e7b08009-8aa4-4c38-be03-cc768f36fc9c tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:08.006056 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e7b08009-8aa4-4c38-be03-cc768f36fc9c tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: db94bd78-8ff3-4784-84bd-e09796f6633a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:08.011820 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e7b08009-8aa4-4c38-be03-cc768f36fc9c tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:08.012267 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e7b08009-8aa4-4c38-be03-cc768f36fc9c tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:08.013035 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e7b08009-8aa4-4c38-be03-cc768f36fc9c tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:08.013466 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e7b08009-8aa4-4c38-be03-cc768f36fc9c tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:08.147195 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e7b08009-8aa4-4c38-be03-cc768f36fc9c tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:08.154697 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e7b08009-8aa4-4c38-be03-cc768f36fc9c tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a" status: 200 len: 1267 microversion: 2.1 time: 0.153529 Nov 16 16:06:08.155257 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 206/378] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:08 2021] GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:08.184358 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-81c19081-2c59-45d8-b2bb-095eacf6f9b4 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:08.184970 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-81c19081-2c59-45d8-b2bb-095eacf6f9b4 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:08.190761 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-81c19081-2c59-45d8-b2bb-095eacf6f9b4 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:08.191896 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-81c19081-2c59-45d8-b2bb-095eacf6f9b4 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:08.192673 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-81c19081-2c59-45d8-b2bb-095eacf6f9b4 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:08.193106 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-81c19081-2c59-45d8-b2bb-095eacf6f9b4 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:08.249161 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0a5b8bc2-7684-4b9e-bc10-a7fc5f1f8faa tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:08.249773 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0a5b8bc2-7684-4b9e-bc10-a7fc5f1f8faa tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] [instance: 0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:08.256663 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0a5b8bc2-7684-4b9e-bc10-a7fc5f1f8faa tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:08.257044 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0a5b8bc2-7684-4b9e-bc10-a7fc5f1f8faa tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:08.257836 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0a5b8bc2-7684-4b9e-bc10-a7fc5f1f8faa tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:08.258269 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0a5b8bc2-7684-4b9e-bc10-a7fc5f1f8faa tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:08.289251 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0a5b8bc2-7684-4b9e-bc10-a7fc5f1f8faa tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:08.289698 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0a5b8bc2-7684-4b9e-bc10-a7fc5f1f8faa tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:08.290145 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.objects.instance [None req-0a5b8bc2-7684-4b9e-bc10-a7fc5f1f8faa tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lazy-loading 'fault' on Instance uuid 0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5 {{(pid=116084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:06:08.336625 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0a5b8bc2-7684-4b9e-bc10-a7fc5f1f8faa tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d9e7cc0fb849e8a3d067214ac3402a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e03b8724364db290573e549b643dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:08.343865 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0a5b8bc2-7684-4b9e-bc10-a7fc5f1f8faa tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] 10.222.0.46 "GET /compute/v2.1/servers/0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5" status: 200 len: 1303 microversion: 2.1 time: 0.098331 Nov 16 16:06:08.344623 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 207/379] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:08 2021] GET /compute/v2.1/servers/0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5 => generated 1303 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:06:08.351064 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-81c19081-2c59-45d8-b2bb-095eacf6f9b4 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:08.358847 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-81c19081-2c59-45d8-b2bb-095eacf6f9b4 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1720 microversion: 2.1 time: 0.178094 Nov 16 16:06:08.359405 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 173/380] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:08 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1720 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:08.616244 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b255a42f-c575-4449-8730-fb9852d6aaa7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:08.616852 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b255a42f-c575-4449-8730-fb9852d6aaa7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:08.622612 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b255a42f-c575-4449-8730-fb9852d6aaa7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:08.623050 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b255a42f-c575-4449-8730-fb9852d6aaa7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:08.623832 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b255a42f-c575-4449-8730-fb9852d6aaa7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:08.624259 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b255a42f-c575-4449-8730-fb9852d6aaa7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:08.756024 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b255a42f-c575-4449-8730-fb9852d6aaa7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:08.763650 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b255a42f-c575-4449-8730-fb9852d6aaa7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:08.765122 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b255a42f-c575-4449-8730-fb9852d6aaa7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:08.766262 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b255a42f-c575-4449-8730-fb9852d6aaa7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1723 microversion: 2.20 time: 0.154727 Nov 16 16:06:08.766823 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 208/381] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:06:08 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:06:09.172345 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-5a8de930-8c2f-41b2-a9bd-e6fe910e6e2f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:09.172875 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-5a8de930-8c2f-41b2-a9bd-e6fe910e6e2f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: db94bd78-8ff3-4784-84bd-e09796f6633a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:09.179929 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5a8de930-8c2f-41b2-a9bd-e6fe910e6e2f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:09.180445 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5a8de930-8c2f-41b2-a9bd-e6fe910e6e2f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:09.181157 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5a8de930-8c2f-41b2-a9bd-e6fe910e6e2f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:09.182055 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5a8de930-8c2f-41b2-a9bd-e6fe910e6e2f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:09.338976 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-5a8de930-8c2f-41b2-a9bd-e6fe910e6e2f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:09.346990 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-5a8de930-8c2f-41b2-a9bd-e6fe910e6e2f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a" status: 200 len: 1267 microversion: 2.1 time: 0.178936 Nov 16 16:06:09.347586 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 174/382] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:09 2021] GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:09.360288 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7e45c432-32cb-44fa-8c1a-403f1494cc4a tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:09.360910 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-7e45c432-32cb-44fa-8c1a-403f1494cc4a tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] [instance: 0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:09.367654 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7e45c432-32cb-44fa-8c1a-403f1494cc4a tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:09.368101 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7e45c432-32cb-44fa-8c1a-403f1494cc4a tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:09.368879 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7e45c432-32cb-44fa-8c1a-403f1494cc4a tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:09.369309 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7e45c432-32cb-44fa-8c1a-403f1494cc4a tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:09.376070 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-dd2754ab-6e61-4220-b404-506a1098f76b tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:09.376829 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-dd2754ab-6e61-4220-b404-506a1098f76b tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:09.383313 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-7e45c432-32cb-44fa-8c1a-403f1494cc4a tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] HTTP exception thrown: Instance 0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5 could not be found. Nov 16 16:06:09.383835 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-dd2754ab-6e61-4220-b404-506a1098f76b tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:09.383947 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7e45c432-32cb-44fa-8c1a-403f1494cc4a tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Returning 404 to user: Instance 0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5 could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:06:09.384431 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-dd2754ab-6e61-4220-b404-506a1098f76b tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:09.384759 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-7e45c432-32cb-44fa-8c1a-403f1494cc4a tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] 10.222.0.46 "GET /compute/v2.1/servers/0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5" status: 404 len: 111 microversion: 2.1 time: 0.028271 Nov 16 16:06:09.385225 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-dd2754ab-6e61-4220-b404-506a1098f76b tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:09.385641 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 209/383] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:09 2021] GET /compute/v2.1/servers/0f1e3e30-c6b6-48c4-97fb-8e16e4d0f0e5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 16 16:06:09.386228 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-dd2754ab-6e61-4220-b404-506a1098f76b tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:09.483983 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d00f9e3e-c33e-4668-afa8-3da5988e9bff tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2063553787", "imageRef": "7c3bd8e0-8d7e-4cf7-90db-742c4f55e405", "flavorRef": "452", "networks": [{"uuid": "3ab3dac8-cc77-4d96-958c-ff31e1be9045"}]}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:06:09.528084 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-dd2754ab-6e61-4220-b404-506a1098f76b tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:09.536697 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-dd2754ab-6e61-4220-b404-506a1098f76b tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1720 microversion: 2.1 time: 0.163709 Nov 16 16:06:09.536841 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.network.neutron [None req-d00f9e3e-c33e-4668-afa8-3da5988e9bff tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] validate_networks() for [('3ab3dac8-cc77-4d96-958c-ff31e1be9045', None, None, None, None, None)] {{(pid=116084) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 16:06:09.537349 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 175/384] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:09 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:09.784593 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-6382c5f3-6a25-4f87-a0db-565b774d96f0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:09.785302 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-6382c5f3-6a25-4f87-a0db-565b774d96f0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:09.791089 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6382c5f3-6a25-4f87-a0db-565b774d96f0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:09.791642 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6382c5f3-6a25-4f87-a0db-565b774d96f0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:09.792483 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6382c5f3-6a25-4f87-a0db-565b774d96f0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:09.792981 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6382c5f3-6a25-4f87-a0db-565b774d96f0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:09.958886 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-d00f9e3e-c33e-4668-afa8-3da5988e9bff tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Flavor limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 16:06:09.959338 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-d00f9e3e-c33e-4668-afa8-3da5988e9bff tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Image limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 16:06:09.959843 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-d00f9e3e-c33e-4668-afa8-3da5988e9bff tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Flavor pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 16:06:09.960263 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-d00f9e3e-c33e-4668-afa8-3da5988e9bff tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Image pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 16:06:09.960676 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-d00f9e3e-c33e-4668-afa8-3da5988e9bff tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 16:06:09.970745 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d00f9e3e-c33e-4668-afa8-3da5988e9bff tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:09.971194 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d00f9e3e-c33e-4668-afa8-3da5988e9bff tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:09.972048 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d00f9e3e-c33e-4668-afa8-3da5988e9bff tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:09.972483 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d00f9e3e-c33e-4668-afa8-3da5988e9bff tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:09.988526 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-d00f9e3e-c33e-4668-afa8-3da5988e9bff tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Getting quotas for project 66e03b8724364db290573e549b643dbf. Resources: {'instances', 'ram', 'cores'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:06:09.993192 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-d00f9e3e-c33e-4668-afa8-3da5988e9bff tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Getting quotas for user e1d9e7cc0fb849e8a3d067214ac3402a and project 66e03b8724364db290573e549b643dbf. Resources: {'instances', 'ram', 'cores'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:06:09.993687 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-6382c5f3-6a25-4f87-a0db-565b774d96f0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:10.001187 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-6382c5f3-6a25-4f87-a0db-565b774d96f0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:10.002838 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-6382c5f3-6a25-4f87-a0db-565b774d96f0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:10.003896 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d00f9e3e-c33e-4668-afa8-3da5988e9bff tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Going to run 1 instances... {{(pid=116084) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 16:06:10.004034 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-6382c5f3-6a25-4f87-a0db-565b774d96f0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1723 microversion: 2.20 time: 0.223058 Nov 16 16:06:10.004539 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 176/385] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:06:09 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:06:10.006981 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d00f9e3e-c33e-4668-afa8-3da5988e9bff tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] [instance: 42b963e7-0efb-4d43-a8af-7558d83decc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c3bd8e0-8d7e-4cf7-90db-742c4f55e405',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116084) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 16:06:10.051417 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d00f9e3e-c33e-4668-afa8-3da5988e9bff tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.571001 Nov 16 16:06:10.052869 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 210/386] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 16 16:06:09 2021] POST /compute/v2.1/servers => generated 380 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 16 16:06:10.066617 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-eed851af-f247-48e2-8908-c5f195449c41 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:10.067291 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-eed851af-f247-48e2-8908-c5f195449c41 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] [instance: 42b963e7-0efb-4d43-a8af-7558d83decc6] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:10.118015 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-eed851af-f247-48e2-8908-c5f195449c41 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d9e7cc0fb849e8a3d067214ac3402a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e03b8724364db290573e549b643dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:10.124501 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-eed851af-f247-48e2-8908-c5f195449c41 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] 10.222.0.46 "GET /compute/v2.1/servers/42b963e7-0efb-4d43-a8af-7558d83decc6" status: 200 len: 1214 microversion: 2.1 time: 0.065902 Nov 16 16:06:10.125094 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 177/387] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:10 2021] GET /compute/v2.1/servers/42b963e7-0efb-4d43-a8af-7558d83decc6 => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:10.365619 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ee4ba6c6-b292-4885-9ce3-aaa90f7c6ff2 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:10.366194 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ee4ba6c6-b292-4885-9ce3-aaa90f7c6ff2 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: db94bd78-8ff3-4784-84bd-e09796f6633a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:10.372716 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ee4ba6c6-b292-4885-9ce3-aaa90f7c6ff2 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:10.373138 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ee4ba6c6-b292-4885-9ce3-aaa90f7c6ff2 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:10.373904 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ee4ba6c6-b292-4885-9ce3-aaa90f7c6ff2 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:10.374350 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ee4ba6c6-b292-4885-9ce3-aaa90f7c6ff2 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:10.513775 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ee4ba6c6-b292-4885-9ce3-aaa90f7c6ff2 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:10.521640 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ee4ba6c6-b292-4885-9ce3-aaa90f7c6ff2 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a" status: 200 len: 1267 microversion: 2.1 time: 0.160863 Nov 16 16:06:10.522226 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 211/388] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:10 2021] GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:10.554109 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-30418ff2-689c-472e-be22-29558eb7056e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:10.554714 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-30418ff2-689c-472e-be22-29558eb7056e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:10.561054 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-30418ff2-689c-472e-be22-29558eb7056e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:10.561484 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-30418ff2-689c-472e-be22-29558eb7056e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:10.562252 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-30418ff2-689c-472e-be22-29558eb7056e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:10.562717 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-30418ff2-689c-472e-be22-29558eb7056e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:10.703755 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-30418ff2-689c-472e-be22-29558eb7056e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:10.712089 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-30418ff2-689c-472e-be22-29558eb7056e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1720 microversion: 2.1 time: 0.162128 Nov 16 16:06:10.712649 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 178/389] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:10 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:11.022571 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-df16aa55-7696-4d66-9cca-74f6c60c9ed1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:11.023181 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-df16aa55-7696-4d66-9cca-74f6c60c9ed1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:11.029232 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-df16aa55-7696-4d66-9cca-74f6c60c9ed1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:11.029679 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-df16aa55-7696-4d66-9cca-74f6c60c9ed1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:11.030642 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-df16aa55-7696-4d66-9cca-74f6c60c9ed1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:11.031275 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-df16aa55-7696-4d66-9cca-74f6c60c9ed1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:11.141569 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-30b33b5d-042b-44a5-a68c-f7e7955854c7 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:11.142332 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-30b33b5d-042b-44a5-a68c-f7e7955854c7 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] [instance: 42b963e7-0efb-4d43-a8af-7558d83decc6] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:11.151691 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-30b33b5d-042b-44a5-a68c-f7e7955854c7 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:11.152172 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-30b33b5d-042b-44a5-a68c-f7e7955854c7 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:11.153298 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-30b33b5d-042b-44a5-a68c-f7e7955854c7 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:11.153734 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-30b33b5d-042b-44a5-a68c-f7e7955854c7 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:11.242451 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-30b33b5d-042b-44a5-a68c-f7e7955854c7 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d9e7cc0fb849e8a3d067214ac3402a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e03b8724364db290573e549b643dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:11.249940 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-30b33b5d-042b-44a5-a68c-f7e7955854c7 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] 10.222.0.46 "GET /compute/v2.1/servers/42b963e7-0efb-4d43-a8af-7558d83decc6" status: 200 len: 1272 microversion: 2.1 time: 0.112877 Nov 16 16:06:11.250827 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 179/390] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:11 2021] GET /compute/v2.1/servers/42b963e7-0efb-4d43-a8af-7558d83decc6 => generated 1272 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:06:11.277601 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-df16aa55-7696-4d66-9cca-74f6c60c9ed1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:11.285544 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-df16aa55-7696-4d66-9cca-74f6c60c9ed1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:11.287298 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-df16aa55-7696-4d66-9cca-74f6c60c9ed1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:11.288627 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-df16aa55-7696-4d66-9cca-74f6c60c9ed1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1723 microversion: 2.20 time: 0.270356 Nov 16 16:06:11.289295 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 212/391] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:06:11 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1723 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:06:11.538883 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-4872517c-a027-4777-811b-5ac895c11dad tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:11.539531 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-4872517c-a027-4777-811b-5ac895c11dad tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: db94bd78-8ff3-4784-84bd-e09796f6633a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:11.545790 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4872517c-a027-4777-811b-5ac895c11dad tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:11.546239 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4872517c-a027-4777-811b-5ac895c11dad tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:11.547019 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4872517c-a027-4777-811b-5ac895c11dad tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:11.547444 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4872517c-a027-4777-811b-5ac895c11dad tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:11.735241 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1d2d78dd-5dcc-41b8-af66-4ae5b8527b15 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:11.735992 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1d2d78dd-5dcc-41b8-af66-4ae5b8527b15 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:11.743345 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1d2d78dd-5dcc-41b8-af66-4ae5b8527b15 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:11.743908 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1d2d78dd-5dcc-41b8-af66-4ae5b8527b15 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:11.744779 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1d2d78dd-5dcc-41b8-af66-4ae5b8527b15 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:11.745286 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1d2d78dd-5dcc-41b8-af66-4ae5b8527b15 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:11.767841 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-4872517c-a027-4777-811b-5ac895c11dad tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:11.776233 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-4872517c-a027-4777-811b-5ac895c11dad tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a" status: 200 len: 1267 microversion: 2.1 time: 0.241724 Nov 16 16:06:11.777751 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 180/392] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:11 2021] GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a => generated 1267 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:11.986647 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1d2d78dd-5dcc-41b8-af66-4ae5b8527b15 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:11.996628 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1d2d78dd-5dcc-41b8-af66-4ae5b8527b15 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1720 microversion: 2.1 time: 0.269225 Nov 16 16:06:11.997463 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 213/393] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:11 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1720 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:12.268124 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-1c7c5879-740e-4e42-8188-256e4cdefbf6 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:12.268748 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-1c7c5879-740e-4e42-8188-256e4cdefbf6 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] [instance: 42b963e7-0efb-4d43-a8af-7558d83decc6] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:12.280169 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1c7c5879-740e-4e42-8188-256e4cdefbf6 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:12.287800 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1c7c5879-740e-4e42-8188-256e4cdefbf6 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:12.289419 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1c7c5879-740e-4e42-8188-256e4cdefbf6 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:12.290204 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1c7c5879-740e-4e42-8188-256e4cdefbf6 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:12.313593 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-fdb92dc5-b1ef-4dd2-8f44-58a56e0130ee tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:12.316114 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-fdb92dc5-b1ef-4dd2-8f44-58a56e0130ee tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:12.326129 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fdb92dc5-b1ef-4dd2-8f44-58a56e0130ee tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:12.326991 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fdb92dc5-b1ef-4dd2-8f44-58a56e0130ee tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:12.330386 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fdb92dc5-b1ef-4dd2-8f44-58a56e0130ee tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:12.331145 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fdb92dc5-b1ef-4dd2-8f44-58a56e0130ee tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:12.643130 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-1c7c5879-740e-4e42-8188-256e4cdefbf6 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d9e7cc0fb849e8a3d067214ac3402a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e03b8724364db290573e549b643dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:12.651708 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-1c7c5879-740e-4e42-8188-256e4cdefbf6 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] 10.222.0.46 "GET /compute/v2.1/servers/42b963e7-0efb-4d43-a8af-7558d83decc6" status: 200 len: 1314 microversion: 2.1 time: 0.387314 Nov 16 16:06:12.652896 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 181/394] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:12 2021] GET /compute/v2.1/servers/42b963e7-0efb-4d43-a8af-7558d83decc6 => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:12.657273 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-72515662-eeb0-4e0e-8008-84f154eb7d8d req-a8c52a44-7ba3-4335-90eb-45f8777785f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db94bd78-8ff3-4784-84bd-e09796f6633a", "name": "network-vif-plugged", "status": "completed", "tag": "b063cfec-1c51-450b-a10e-50021e43d561"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:06:12.659173 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:06:12.659173 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Nov 16 16:06:12.664729 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-fdb92dc5-b1ef-4dd2-8f44-58a56e0130ee tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:12.673525 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-fdb92dc5-b1ef-4dd2-8f44-58a56e0130ee tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:12.674970 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-fdb92dc5-b1ef-4dd2-8f44-58a56e0130ee tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:12.676147 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-fdb92dc5-b1ef-4dd2-8f44-58a56e0130ee tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1723 microversion: 2.20 time: 0.369084 Nov 16 16:06:12.682219 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-72515662-eeb0-4e0e-8008-84f154eb7d8d req-a8c52a44-7ba3-4335-90eb-45f8777785f2 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:12.682647 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-72515662-eeb0-4e0e-8008-84f154eb7d8d req-a8c52a44-7ba3-4335-90eb-45f8777785f2 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:12.682975 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 214/395] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:06:12 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1723 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:06:12.705478 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-72515662-eeb0-4e0e-8008-84f154eb7d8d req-a8c52a44-7ba3-4335-90eb-45f8777785f2 service nova] Creating event network-vif-plugged:b063cfec-1c51-450b-a10e-50021e43d561 for instance db94bd78-8ff3-4784-84bd-e09796f6633a on hv-cinder-81809 Nov 16 16:06:12.712493 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-72515662-eeb0-4e0e-8008-84f154eb7d8d req-a8c52a44-7ba3-4335-90eb-45f8777785f2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057630 Nov 16 16:06:12.718333 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 182/396] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:06:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:06:12.795440 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-85851742-76b4-4d8b-a957-51f4ce18cbbf tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:12.796080 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-85851742-76b4-4d8b-a957-51f4ce18cbbf tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: db94bd78-8ff3-4784-84bd-e09796f6633a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:12.803334 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-85851742-76b4-4d8b-a957-51f4ce18cbbf tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:12.803904 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-85851742-76b4-4d8b-a957-51f4ce18cbbf tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:12.805035 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-85851742-76b4-4d8b-a957-51f4ce18cbbf tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:12.805481 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-85851742-76b4-4d8b-a957-51f4ce18cbbf tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:12.969301 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-acc87d68-2bc1-4d5f-add1-97b2687efab2 req-63661c89-ef21-4c7a-ab45-1372a756a9b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42b963e7-0efb-4d43-a8af-7558d83decc6", "tag": "80bb11cb-f6bb-4bfd-9286-ef445e19918b"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:06:12.970864 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:06:12.970864 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Nov 16 16:06:12.978651 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-acc87d68-2bc1-4d5f-add1-97b2687efab2 req-63661c89-ef21-4c7a-ab45-1372a756a9b0 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:12.979108 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-acc87d68-2bc1-4d5f-add1-97b2687efab2 req-63661c89-ef21-4c7a-ab45-1372a756a9b0 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:12.992123 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-acc87d68-2bc1-4d5f-add1-97b2687efab2 req-63661c89-ef21-4c7a-ab45-1372a756a9b0 service nova] Creating event network-changed:80bb11cb-f6bb-4bfd-9286-ef445e19918b for instance 42b963e7-0efb-4d43-a8af-7558d83decc6 on hv-cinder-81809 Nov 16 16:06:12.996850 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-acc87d68-2bc1-4d5f-add1-97b2687efab2 req-63661c89-ef21-4c7a-ab45-1372a756a9b0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031588 Nov 16 16:06:12.997452 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 183/397] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:06:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:06:13.014635 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-3c4350c8-e69f-4a71-8ed1-de286d645bbe tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:13.015452 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-3c4350c8-e69f-4a71-8ed1-de286d645bbe tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:13.021608 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3c4350c8-e69f-4a71-8ed1-de286d645bbe tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:13.022058 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3c4350c8-e69f-4a71-8ed1-de286d645bbe tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:13.022842 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3c4350c8-e69f-4a71-8ed1-de286d645bbe tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:13.023295 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3c4350c8-e69f-4a71-8ed1-de286d645bbe tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:13.057945 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-85851742-76b4-4d8b-a957-51f4ce18cbbf tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:13.065945 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-85851742-76b4-4d8b-a957-51f4ce18cbbf tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a" status: 200 len: 1267 microversion: 2.1 time: 0.274024 Nov 16 16:06:13.067018 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 215/398] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:12 2021] GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a => generated 1267 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:13.204715 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-3c4350c8-e69f-4a71-8ed1-de286d645bbe tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:13.213630 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-3c4350c8-e69f-4a71-8ed1-de286d645bbe tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1720 microversion: 2.1 time: 0.203070 Nov 16 16:06:13.214195 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 184/399] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:13 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1720 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:06:13.669720 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-366e0a95-880c-4317-b9f0-59f0ccbc3ce1 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:13.670239 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-366e0a95-880c-4317-b9f0-59f0ccbc3ce1 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] [instance: 42b963e7-0efb-4d43-a8af-7558d83decc6] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:13.684854 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-366e0a95-880c-4317-b9f0-59f0ccbc3ce1 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:13.685307 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-366e0a95-880c-4317-b9f0-59f0ccbc3ce1 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:13.686126 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-366e0a95-880c-4317-b9f0-59f0ccbc3ce1 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:13.686570 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-366e0a95-880c-4317-b9f0-59f0ccbc3ce1 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:13.702851 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-53c67682-e389-4703-bf83-ce0dfcf96036 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:13.703724 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-53c67682-e389-4703-bf83-ce0dfcf96036 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:13.713136 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-53c67682-e389-4703-bf83-ce0dfcf96036 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:13.713616 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-53c67682-e389-4703-bf83-ce0dfcf96036 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:13.714568 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-53c67682-e389-4703-bf83-ce0dfcf96036 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:13.715010 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-53c67682-e389-4703-bf83-ce0dfcf96036 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:13.953600 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-53c67682-e389-4703-bf83-ce0dfcf96036 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:13.956892 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-366e0a95-880c-4317-b9f0-59f0ccbc3ce1 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d9e7cc0fb849e8a3d067214ac3402a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e03b8724364db290573e549b643dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:13.965942 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-53c67682-e389-4703-bf83-ce0dfcf96036 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:13.967429 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-53c67682-e389-4703-bf83-ce0dfcf96036 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:13.968621 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-53c67682-e389-4703-bf83-ce0dfcf96036 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1744 microversion: 2.20 time: 0.270691 Nov 16 16:06:13.973144 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-366e0a95-880c-4317-b9f0-59f0ccbc3ce1 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] 10.222.0.46 "GET /compute/v2.1/servers/42b963e7-0efb-4d43-a8af-7558d83decc6" status: 200 len: 1314 microversion: 2.1 time: 0.307105 Nov 16 16:06:13.982598 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 216/400] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:13 2021] GET /compute/v2.1/servers/42b963e7-0efb-4d43-a8af-7558d83decc6 => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:13.982773 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 185/401] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:06:13 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1744 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:06:14.084720 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ebc85e39-e236-43a4-9e9d-a7d782b16353 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:14.085273 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ebc85e39-e236-43a4-9e9d-a7d782b16353 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: db94bd78-8ff3-4784-84bd-e09796f6633a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:14.097011 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ebc85e39-e236-43a4-9e9d-a7d782b16353 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:14.097469 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ebc85e39-e236-43a4-9e9d-a7d782b16353 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:14.098340 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ebc85e39-e236-43a4-9e9d-a7d782b16353 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:14.098991 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ebc85e39-e236-43a4-9e9d-a7d782b16353 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:14.230177 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-f1d21a03-32a5-4127-bfb3-c31edd74399f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:14.231371 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-f1d21a03-32a5-4127-bfb3-c31edd74399f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:14.237499 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f1d21a03-32a5-4127-bfb3-c31edd74399f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:14.238135 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f1d21a03-32a5-4127-bfb3-c31edd74399f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:14.239511 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f1d21a03-32a5-4127-bfb3-c31edd74399f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:14.240078 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f1d21a03-32a5-4127-bfb3-c31edd74399f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:14.248668 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ebc85e39-e236-43a4-9e9d-a7d782b16353 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:14.257641 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ebc85e39-e236-43a4-9e9d-a7d782b16353 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a" status: 200 len: 1267 microversion: 2.1 time: 0.177735 Nov 16 16:06:14.258559 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 217/402] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:14 2021] GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:14.387648 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-f1d21a03-32a5-4127-bfb3-c31edd74399f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:14.396366 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-f1d21a03-32a5-4127-bfb3-c31edd74399f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1720 microversion: 2.1 time: 0.170003 Nov 16 16:06:14.396955 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 186/403] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:14 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1720 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:06:14.990283 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-4a527c80-a620-4157-9074-4dedcef7e52c tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:14.990893 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-4a527c80-a620-4157-9074-4dedcef7e52c tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] [instance: 42b963e7-0efb-4d43-a8af-7558d83decc6] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:14.993499 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-f14617f0-e33e-408d-96f1-39289d658a67 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:14.994136 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-f14617f0-e33e-408d-96f1-39289d658a67 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:14.998833 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4a527c80-a620-4157-9074-4dedcef7e52c tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:14.999289 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4a527c80-a620-4157-9074-4dedcef7e52c tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:15.000123 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4a527c80-a620-4157-9074-4dedcef7e52c tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:15.000297 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f14617f0-e33e-408d-96f1-39289d658a67 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:15.000592 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4a527c80-a620-4157-9074-4dedcef7e52c tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:15.000731 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f14617f0-e33e-408d-96f1-39289d658a67 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:15.001493 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f14617f0-e33e-408d-96f1-39289d658a67 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:15.001917 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f14617f0-e33e-408d-96f1-39289d658a67 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:15.194643 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-f14617f0-e33e-408d-96f1-39289d658a67 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:15.202938 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-f14617f0-e33e-408d-96f1-39289d658a67 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:15.204236 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-4a527c80-a620-4157-9074-4dedcef7e52c tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d9e7cc0fb849e8a3d067214ac3402a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e03b8724364db290573e549b643dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:15.204642 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-f14617f0-e33e-408d-96f1-39289d658a67 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:15.205880 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-f14617f0-e33e-408d-96f1-39289d658a67 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1744 microversion: 2.20 time: 0.217199 Nov 16 16:06:15.206640 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 187/404] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:06:14 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1744 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:06:15.211720 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-4a527c80-a620-4157-9074-4dedcef7e52c tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] 10.222.0.46 "GET /compute/v2.1/servers/42b963e7-0efb-4d43-a8af-7558d83decc6" status: 200 len: 1314 microversion: 2.1 time: 0.225765 Nov 16 16:06:15.212279 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 218/405] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:14 2021] GET /compute/v2.1/servers/42b963e7-0efb-4d43-a8af-7558d83decc6 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:15.274262 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-695a74f8-9e81-44ac-afd4-2d9992edbf6a tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:15.274869 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-695a74f8-9e81-44ac-afd4-2d9992edbf6a tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: db94bd78-8ff3-4784-84bd-e09796f6633a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:15.280915 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-695a74f8-9e81-44ac-afd4-2d9992edbf6a tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:15.281355 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-695a74f8-9e81-44ac-afd4-2d9992edbf6a tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:15.282116 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-695a74f8-9e81-44ac-afd4-2d9992edbf6a tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:15.282542 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-695a74f8-9e81-44ac-afd4-2d9992edbf6a tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:15.414620 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d6304e00-2991-44b7-8f0f-338054b2d3c8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:15.415162 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d6304e00-2991-44b7-8f0f-338054b2d3c8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:15.421356 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d6304e00-2991-44b7-8f0f-338054b2d3c8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:15.421805 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d6304e00-2991-44b7-8f0f-338054b2d3c8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:15.422594 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d6304e00-2991-44b7-8f0f-338054b2d3c8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:15.423034 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d6304e00-2991-44b7-8f0f-338054b2d3c8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:15.620572 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d6304e00-2991-44b7-8f0f-338054b2d3c8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:15.624527 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-695a74f8-9e81-44ac-afd4-2d9992edbf6a tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:15.628484 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d6304e00-2991-44b7-8f0f-338054b2d3c8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1720 microversion: 2.1 time: 0.218128 Nov 16 16:06:15.632782 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-695a74f8-9e81-44ac-afd4-2d9992edbf6a tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a" status: 200 len: 1267 microversion: 2.1 time: 0.362130 Nov 16 16:06:15.633422 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 188/406] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:15 2021] GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a => generated 1267 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:15.638089 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 219/407] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:15 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1720 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:06:16.225326 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-6c24a6d3-0ca7-4613-8d64-ce716b1b80b9 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:16.226462 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-6c24a6d3-0ca7-4613-8d64-ce716b1b80b9 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:16.228350 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e5ab0ee8-1d6a-496b-a421-98d98160070c tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:16.229384 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e5ab0ee8-1d6a-496b-a421-98d98160070c tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] [instance: 42b963e7-0efb-4d43-a8af-7558d83decc6] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:16.232489 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6c24a6d3-0ca7-4613-8d64-ce716b1b80b9 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:16.232931 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6c24a6d3-0ca7-4613-8d64-ce716b1b80b9 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:16.233711 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6c24a6d3-0ca7-4613-8d64-ce716b1b80b9 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:16.234139 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6c24a6d3-0ca7-4613-8d64-ce716b1b80b9 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:16.235686 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e5ab0ee8-1d6a-496b-a421-98d98160070c tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:16.236130 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e5ab0ee8-1d6a-496b-a421-98d98160070c tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:16.236943 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e5ab0ee8-1d6a-496b-a421-98d98160070c tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:16.237375 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e5ab0ee8-1d6a-496b-a421-98d98160070c tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:16.635187 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-6c24a6d3-0ca7-4613-8d64-ce716b1b80b9 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:16.638556 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e5ab0ee8-1d6a-496b-a421-98d98160070c tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d9e7cc0fb849e8a3d067214ac3402a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e03b8724364db290573e549b643dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:16.643309 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-6c24a6d3-0ca7-4613-8d64-ce716b1b80b9 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:16.644978 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-6c24a6d3-0ca7-4613-8d64-ce716b1b80b9 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:16.646068 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e5ab0ee8-1d6a-496b-a421-98d98160070c tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] 10.222.0.46 "GET /compute/v2.1/servers/42b963e7-0efb-4d43-a8af-7558d83decc6" status: 200 len: 1314 microversion: 2.1 time: 0.421349 Nov 16 16:06:16.646649 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 220/408] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:16 2021] GET /compute/v2.1/servers/42b963e7-0efb-4d43-a8af-7558d83decc6 => generated 1314 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:06:16.646843 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-6c24a6d3-0ca7-4613-8d64-ce716b1b80b9 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1744 microversion: 2.20 time: 0.425732 Nov 16 16:06:16.647573 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 189/409] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:06:16 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1744 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:06:16.651087 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-9b48258f-92fa-4184-a600-50d3561adafd tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:16.651719 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-9b48258f-92fa-4184-a600-50d3561adafd tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:16.656868 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-0d599cbe-5179-4a51-9163-58cbf4becd14 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:16.657581 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-0d599cbe-5179-4a51-9163-58cbf4becd14 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: db94bd78-8ff3-4784-84bd-e09796f6633a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:16.659946 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9b48258f-92fa-4184-a600-50d3561adafd tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:16.660399 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9b48258f-92fa-4184-a600-50d3561adafd tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:16.661340 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9b48258f-92fa-4184-a600-50d3561adafd tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:16.661780 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9b48258f-92fa-4184-a600-50d3561adafd tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:16.664372 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0d599cbe-5179-4a51-9163-58cbf4becd14 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:16.664809 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0d599cbe-5179-4a51-9163-58cbf4becd14 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:16.665581 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0d599cbe-5179-4a51-9163-58cbf4becd14 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:16.666007 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0d599cbe-5179-4a51-9163-58cbf4becd14 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:16.857635 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-9b48258f-92fa-4184-a600-50d3561adafd tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:16.860711 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-0d599cbe-5179-4a51-9163-58cbf4becd14 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:16.866708 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-9b48258f-92fa-4184-a600-50d3561adafd tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1720 microversion: 2.1 time: 0.218983 Nov 16 16:06:16.867373 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 221/410] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:16 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1720 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:16.869332 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-0d599cbe-5179-4a51-9163-58cbf4becd14 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a" status: 200 len: 1267 microversion: 2.1 time: 0.216210 Nov 16 16:06:16.869960 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 190/411] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:16 2021] GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a => generated 1267 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:17.663272 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ad761231-adf7-4691-a970-ba3bbe4030ff tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:17.664001 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ad761231-adf7-4691-a970-ba3bbe4030ff tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] [instance: 42b963e7-0efb-4d43-a8af-7558d83decc6] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:17.665133 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-97be1090-8b39-44a9-afb2-e3cc4cf2c2a8 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:17.665757 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-97be1090-8b39-44a9-afb2-e3cc4cf2c2a8 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:17.670370 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ad761231-adf7-4691-a970-ba3bbe4030ff tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:17.670825 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ad761231-adf7-4691-a970-ba3bbe4030ff tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:17.671650 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ad761231-adf7-4691-a970-ba3bbe4030ff tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:17.672092 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ad761231-adf7-4691-a970-ba3bbe4030ff tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:17.672210 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-97be1090-8b39-44a9-afb2-e3cc4cf2c2a8 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:17.672541 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-97be1090-8b39-44a9-afb2-e3cc4cf2c2a8 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:17.674137 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-97be1090-8b39-44a9-afb2-e3cc4cf2c2a8 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:17.674590 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-97be1090-8b39-44a9-afb2-e3cc4cf2c2a8 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:17.887672 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-97be1090-8b39-44a9-afb2-e3cc4cf2c2a8 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:17.890577 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ad761231-adf7-4691-a970-ba3bbe4030ff tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d9e7cc0fb849e8a3d067214ac3402a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e03b8724364db290573e549b643dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:17.898258 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-97be1090-8b39-44a9-afb2-e3cc4cf2c2a8 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:17.900361 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-97be1090-8b39-44a9-afb2-e3cc4cf2c2a8 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:17.901267 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ad761231-adf7-4691-a970-ba3bbe4030ff tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] 10.222.0.46 "GET /compute/v2.1/servers/42b963e7-0efb-4d43-a8af-7558d83decc6" status: 200 len: 1314 microversion: 2.1 time: 0.240554 Nov 16 16:06:17.901889 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 222/412] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:17 2021] GET /compute/v2.1/servers/42b963e7-0efb-4d43-a8af-7558d83decc6 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:17.907619 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b3bcf0d2-c622-4b85-af97-7f4d97661c90 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:17.908225 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b3bcf0d2-c622-4b85-af97-7f4d97661c90 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:17.915621 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b3bcf0d2-c622-4b85-af97-7f4d97661c90 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:17.915713 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b3bcf0d2-c622-4b85-af97-7f4d97661c90 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:17.916644 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b3bcf0d2-c622-4b85-af97-7f4d97661c90 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:17.917084 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b3bcf0d2-c622-4b85-af97-7f4d97661c90 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:17.922995 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-97be1090-8b39-44a9-afb2-e3cc4cf2c2a8 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1744 microversion: 2.20 time: 0.261443 Nov 16 16:06:17.923955 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 191/413] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:06:17 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1744 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:06:17.937924 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-0e6ce706-64f1-4d81-9f45-5f1610a58a06 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:17.938626 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-0e6ce706-64f1-4d81-9f45-5f1610a58a06 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: db94bd78-8ff3-4784-84bd-e09796f6633a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:17.950115 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0e6ce706-64f1-4d81-9f45-5f1610a58a06 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:17.951789 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0e6ce706-64f1-4d81-9f45-5f1610a58a06 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:17.955958 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0e6ce706-64f1-4d81-9f45-5f1610a58a06 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:17.956741 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0e6ce706-64f1-4d81-9f45-5f1610a58a06 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:18.175524 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b3bcf0d2-c622-4b85-af97-7f4d97661c90 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:18.179734 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-0e6ce706-64f1-4d81-9f45-5f1610a58a06 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:18.184110 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b3bcf0d2-c622-4b85-af97-7f4d97661c90 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1720 microversion: 2.1 time: 0.280733 Nov 16 16:06:18.189814 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 223/414] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:17 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1720 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:18.189995 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-0e6ce706-64f1-4d81-9f45-5f1610a58a06 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a" status: 200 len: 1453 microversion: 2.1 time: 0.263315 Nov 16 16:06:18.189995 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 192/415] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:17 2021] GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a => generated 1453 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:18.205111 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-37518632-d00b-4a08-b4e2-88a8435c2984 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:18.205866 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-37518632-d00b-4a08-b4e2-88a8435c2984 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: db94bd78-8ff3-4784-84bd-e09796f6633a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:18.220320 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-37518632-d00b-4a08-b4e2-88a8435c2984 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:18.220320 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-37518632-d00b-4a08-b4e2-88a8435c2984 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:18.220320 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-37518632-d00b-4a08-b4e2-88a8435c2984 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:18.220320 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-37518632-d00b-4a08-b4e2-88a8435c2984 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:18.359904 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-37518632-d00b-4a08-b4e2-88a8435c2984 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:18.368395 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-37518632-d00b-4a08-b4e2-88a8435c2984 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a" status: 200 len: 1453 microversion: 2.1 time: 0.166971 Nov 16 16:06:18.368968 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 224/416] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:18 2021] GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a => generated 1453 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:18.919560 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-83e02b51-976a-431e-a615-7c898fc74f30 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:18.920172 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-83e02b51-976a-431e-a615-7c898fc74f30 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] [instance: 42b963e7-0efb-4d43-a8af-7558d83decc6] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:18.926327 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-83e02b51-976a-431e-a615-7c898fc74f30 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:18.927254 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-83e02b51-976a-431e-a615-7c898fc74f30 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:18.928449 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-83e02b51-976a-431e-a615-7c898fc74f30 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:18.928910 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-83e02b51-976a-431e-a615-7c898fc74f30 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:18.943080 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-84485112-a0c6-4f0c-ad9b-769281e4baa5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:18.944469 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-84485112-a0c6-4f0c-ad9b-769281e4baa5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:18.950872 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-84485112-a0c6-4f0c-ad9b-769281e4baa5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:18.951320 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-84485112-a0c6-4f0c-ad9b-769281e4baa5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:18.952347 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-84485112-a0c6-4f0c-ad9b-769281e4baa5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:18.952782 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-84485112-a0c6-4f0c-ad9b-769281e4baa5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:19.147727 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-83e02b51-976a-431e-a615-7c898fc74f30 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d9e7cc0fb849e8a3d067214ac3402a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e03b8724364db290573e549b643dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:19.155485 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-83e02b51-976a-431e-a615-7c898fc74f30 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] 10.222.0.46 "GET /compute/v2.1/servers/42b963e7-0efb-4d43-a8af-7558d83decc6" status: 200 len: 1314 microversion: 2.1 time: 0.239603 Nov 16 16:06:19.156641 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 193/417] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:18 2021] GET /compute/v2.1/servers/42b963e7-0efb-4d43-a8af-7558d83decc6 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:19.160304 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-84485112-a0c6-4f0c-ad9b-769281e4baa5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:19.169277 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-84485112-a0c6-4f0c-ad9b-769281e4baa5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:19.170855 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-84485112-a0c6-4f0c-ad9b-769281e4baa5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:19.172109 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-84485112-a0c6-4f0c-ad9b-769281e4baa5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1739 microversion: 2.20 time: 0.233959 Nov 16 16:06:19.172766 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 225/418] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:06:18 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1739 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:06:19.201909 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-a3b13224-3a9d-4b18-877d-48e472f9feee tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:19.202520 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-a3b13224-3a9d-4b18-877d-48e472f9feee tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:19.212335 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a3b13224-3a9d-4b18-877d-48e472f9feee tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:19.213178 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a3b13224-3a9d-4b18-877d-48e472f9feee tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:19.213587 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a3b13224-3a9d-4b18-877d-48e472f9feee tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:19.214023 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a3b13224-3a9d-4b18-877d-48e472f9feee tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:19.365194 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-a3b13224-3a9d-4b18-877d-48e472f9feee tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:19.374100 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-a3b13224-3a9d-4b18-877d-48e472f9feee tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1720 microversion: 2.1 time: 0.175766 Nov 16 16:06:19.374667 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 194/419] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:19 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1720 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:06:20.172451 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-4ee4fab7-3989-46aa-a86a-f24760fcd489 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:20.172987 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-4ee4fab7-3989-46aa-a86a-f24760fcd489 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] [instance: 42b963e7-0efb-4d43-a8af-7558d83decc6] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:20.179877 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4ee4fab7-3989-46aa-a86a-f24760fcd489 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:20.180367 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4ee4fab7-3989-46aa-a86a-f24760fcd489 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:20.181289 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4ee4fab7-3989-46aa-a86a-f24760fcd489 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:20.181725 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4ee4fab7-3989-46aa-a86a-f24760fcd489 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:20.191536 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-5d4282b7-7305-4464-b747-7e595df23a94 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:20.192835 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-5d4282b7-7305-4464-b747-7e595df23a94 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:20.199354 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5d4282b7-7305-4464-b747-7e595df23a94 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:20.200151 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5d4282b7-7305-4464-b747-7e595df23a94 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:20.201306 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5d4282b7-7305-4464-b747-7e595df23a94 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:20.201747 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5d4282b7-7305-4464-b747-7e595df23a94 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:20.389451 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-4ee4fab7-3989-46aa-a86a-f24760fcd489 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d9e7cc0fb849e8a3d067214ac3402a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e03b8724364db290573e549b643dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:20.401519 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-5d4282b7-7305-4464-b747-7e595df23a94 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:20.402777 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-4ee4fab7-3989-46aa-a86a-f24760fcd489 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] 10.222.0.46 "GET /compute/v2.1/servers/42b963e7-0efb-4d43-a8af-7558d83decc6" status: 200 len: 1314 microversion: 2.1 time: 0.233645 Nov 16 16:06:20.411518 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-5d4282b7-7305-4464-b747-7e595df23a94 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:20.413468 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-5d4282b7-7305-4464-b747-7e595df23a94 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:20.414633 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-5d4282b7-7305-4464-b747-7e595df23a94 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1739 microversion: 2.20 time: 0.227001 Nov 16 16:06:20.415177 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 195/420] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:06:20 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1739 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:06:20.418066 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 226/421] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:20 2021] GET /compute/v2.1/servers/42b963e7-0efb-4d43-a8af-7558d83decc6 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:20.430767 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b68365ad-615a-4789-9239-7a1470238915 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:20.431397 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b68365ad-615a-4789-9239-7a1470238915 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:20.431721 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-f6eed62e-8392-4b07-98bd-edd60b907ad9 req-14cbc798-bcc2-4f96-a914-63643d4fa8c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db94bd78-8ff3-4784-84bd-e09796f6633a", "tag": "b063cfec-1c51-450b-a10e-50021e43d561"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:06:20.433277 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:06:20.433277 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Nov 16 16:06:20.437372 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b68365ad-615a-4789-9239-7a1470238915 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:20.438068 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b68365ad-615a-4789-9239-7a1470238915 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:20.439060 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b68365ad-615a-4789-9239-7a1470238915 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:20.439526 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b68365ad-615a-4789-9239-7a1470238915 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:20.440920 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-f6eed62e-8392-4b07-98bd-edd60b907ad9 req-14cbc798-bcc2-4f96-a914-63643d4fa8c5 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:20.441353 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-f6eed62e-8392-4b07-98bd-edd60b907ad9 req-14cbc798-bcc2-4f96-a914-63643d4fa8c5 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:20.455361 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-f6eed62e-8392-4b07-98bd-edd60b907ad9 req-14cbc798-bcc2-4f96-a914-63643d4fa8c5 service nova] Creating event network-changed:b063cfec-1c51-450b-a10e-50021e43d561 for instance db94bd78-8ff3-4784-84bd-e09796f6633a on hv-cinder-81809 Nov 16 16:06:20.461318 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-f6eed62e-8392-4b07-98bd-edd60b907ad9 req-14cbc798-bcc2-4f96-a914-63643d4fa8c5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044724 Nov 16 16:06:20.461920 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 196/422] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:06:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:06:20.586404 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b68365ad-615a-4789-9239-7a1470238915 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:20.594370 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b68365ad-615a-4789-9239-7a1470238915 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1720 microversion: 2.1 time: 0.176391 Nov 16 16:06:20.594945 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 227/423] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:20 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1720 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:21.433412 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b645fdd5-de75-42f9-8931-4f02b63c2b55 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:21.434939 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b645fdd5-de75-42f9-8931-4f02b63c2b55 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:21.435117 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-c078646d-bac8-4698-a353-043751e92132 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:21.440461 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-c078646d-bac8-4698-a353-043751e92132 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] [instance: 42b963e7-0efb-4d43-a8af-7558d83decc6] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:21.444229 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b645fdd5-de75-42f9-8931-4f02b63c2b55 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:21.444886 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b645fdd5-de75-42f9-8931-4f02b63c2b55 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:21.446082 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b645fdd5-de75-42f9-8931-4f02b63c2b55 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:21.446794 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b645fdd5-de75-42f9-8931-4f02b63c2b55 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:21.457395 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c078646d-bac8-4698-a353-043751e92132 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:21.458484 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c078646d-bac8-4698-a353-043751e92132 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:21.459292 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c078646d-bac8-4698-a353-043751e92132 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:21.459761 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c078646d-bac8-4698-a353-043751e92132 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:21.697745 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b645fdd5-de75-42f9-8931-4f02b63c2b55 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:21.707338 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b645fdd5-de75-42f9-8931-4f02b63c2b55 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:21.710874 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b645fdd5-de75-42f9-8931-4f02b63c2b55 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:21.720204 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b645fdd5-de75-42f9-8931-4f02b63c2b55 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1739 microversion: 2.20 time: 0.291355 Nov 16 16:06:21.721317 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 228/424] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:06:21 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1739 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:06:21.731017 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-4510a719-4441-423e-8230-27dde69580be tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:21.731898 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-4510a719-4441-423e-8230-27dde69580be tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:21.759044 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4510a719-4441-423e-8230-27dde69580be tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:21.759778 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4510a719-4441-423e-8230-27dde69580be tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:21.760583 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4510a719-4441-423e-8230-27dde69580be tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:21.761017 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4510a719-4441-423e-8230-27dde69580be tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:21.836135 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-c078646d-bac8-4698-a353-043751e92132 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d9e7cc0fb849e8a3d067214ac3402a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e03b8724364db290573e549b643dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:21.863067 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-c078646d-bac8-4698-a353-043751e92132 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] 10.222.0.46 "GET /compute/v2.1/servers/42b963e7-0efb-4d43-a8af-7558d83decc6" status: 200 len: 1314 microversion: 2.1 time: 0.434240 Nov 16 16:06:21.868071 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 197/425] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:21 2021] GET /compute/v2.1/servers/42b963e7-0efb-4d43-a8af-7558d83decc6 => generated 1314 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:22.012342 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-4510a719-4441-423e-8230-27dde69580be tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:22.021221 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-4510a719-4441-423e-8230-27dde69580be tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1720 microversion: 2.1 time: 0.298412 Nov 16 16:06:22.022035 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 229/426] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:21 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1720 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:22.090453 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-f94d3435-3528-4d36-b952-50d7725fa4f8 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:06:22.091416 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-f94d3435-3528-4d36-b952-50d7725fa4f8 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:22.097570 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f94d3435-3528-4d36-b952-50d7725fa4f8 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:22.098039 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f94d3435-3528-4d36-b952-50d7725fa4f8 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:22.099596 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f94d3435-3528-4d36-b952-50d7725fa4f8 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:22.100377 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f94d3435-3528-4d36-b952-50d7725fa4f8 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:22.127046 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.objects.instance [None req-f94d3435-3528-4d36-b952-50d7725fa4f8 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lazy-loading 'flavor' on Instance uuid 69df60e2-42c9-4caa-abdc-a7ecb61d8d73 {{(pid=116085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:06:22.294062 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-f94d3435-3528-4d36-b952-50d7725fa4f8 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "POST /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73/action" status: 200 len: 32 microversion: 2.1 time: 0.207382 Nov 16 16:06:22.294742 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 198/427] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:06:22 2021] POST /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73/action => generated 32 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 16:06:22.303968 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6956ace0-b931-41b3-a884-47c577cc66fb tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:22.304920 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-6956ace0-b931-41b3-a884-47c577cc66fb tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:22.311434 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6956ace0-b931-41b3-a884-47c577cc66fb tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:22.312361 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6956ace0-b931-41b3-a884-47c577cc66fb tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:22.313416 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6956ace0-b931-41b3-a884-47c577cc66fb tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:22.313869 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6956ace0-b931-41b3-a884-47c577cc66fb tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:22.493262 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-6956ace0-b931-41b3-a884-47c577cc66fb tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:22.521018 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-6956ace0-b931-41b3-a884-47c577cc66fb tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1568 microversion: 2.1 time: 0.221126 Nov 16 16:06:22.521930 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 230/428] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:22 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1568 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:22.749622 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-74a0d81e-27b6-4a98-9049-347b35444a12 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:22.750618 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-74a0d81e-27b6-4a98-9049-347b35444a12 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:22.766829 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-74a0d81e-27b6-4a98-9049-347b35444a12 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:22.767056 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-74a0d81e-27b6-4a98-9049-347b35444a12 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:22.768059 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-74a0d81e-27b6-4a98-9049-347b35444a12 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:22.772459 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-74a0d81e-27b6-4a98-9049-347b35444a12 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:22.885751 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-2ea58e3d-9d97-4206-9efd-e75a9d8dafb4 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:22.886359 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-2ea58e3d-9d97-4206-9efd-e75a9d8dafb4 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] [instance: 42b963e7-0efb-4d43-a8af-7558d83decc6] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:22.895248 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2ea58e3d-9d97-4206-9efd-e75a9d8dafb4 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:22.896314 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2ea58e3d-9d97-4206-9efd-e75a9d8dafb4 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:22.898269 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2ea58e3d-9d97-4206-9efd-e75a9d8dafb4 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:22.902474 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2ea58e3d-9d97-4206-9efd-e75a9d8dafb4 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:23.120855 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-74a0d81e-27b6-4a98-9049-347b35444a12 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:23.133773 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-74a0d81e-27b6-4a98-9049-347b35444a12 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:23.136941 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-74a0d81e-27b6-4a98-9049-347b35444a12 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:23.142811 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-2ea58e3d-9d97-4206-9efd-e75a9d8dafb4 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d9e7cc0fb849e8a3d067214ac3402a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e03b8724364db290573e549b643dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:23.148396 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-74a0d81e-27b6-4a98-9049-347b35444a12 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1739 microversion: 2.20 time: 0.412554 Nov 16 16:06:23.153120 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-2ea58e3d-9d97-4206-9efd-e75a9d8dafb4 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] 10.222.0.46 "GET /compute/v2.1/servers/42b963e7-0efb-4d43-a8af-7558d83decc6" status: 200 len: 1314 microversion: 2.1 time: 0.271408 Nov 16 16:06:23.154824 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 199/429] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:06:22 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1739 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:06:23.157078 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 231/430] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:22 2021] GET /compute/v2.1/servers/42b963e7-0efb-4d43-a8af-7558d83decc6 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:06:23.161582 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-47ff4742-e1ae-4237-b820-2e4d4ae7cbad tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:23.168529 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-47ff4742-e1ae-4237-b820-2e4d4ae7cbad tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:23.190478 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-47ff4742-e1ae-4237-b820-2e4d4ae7cbad tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:23.193266 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-47ff4742-e1ae-4237-b820-2e4d4ae7cbad tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:23.196252 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-47ff4742-e1ae-4237-b820-2e4d4ae7cbad tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:23.196975 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-47ff4742-e1ae-4237-b820-2e4d4ae7cbad tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:23.430757 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-47ff4742-e1ae-4237-b820-2e4d4ae7cbad tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:23.480273 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-47ff4742-e1ae-4237-b820-2e4d4ae7cbad tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1720 microversion: 2.1 time: 0.316566 Nov 16 16:06:23.480404 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-0bb53904-6b81-4126-9b16-bb1c2786a1be req-6ebcc44a-eba9-4c3b-b4f0-da274b63b7e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42b963e7-0efb-4d43-a8af-7558d83decc6", "name": "network-vif-plugged", "status": "completed", "tag": "80bb11cb-f6bb-4bfd-9286-ef445e19918b"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:06:23.480404 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:06:23.480404 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Nov 16 16:06:23.484510 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 200/431] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:23 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1720 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:23.490152 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-0bb53904-6b81-4126-9b16-bb1c2786a1be req-6ebcc44a-eba9-4c3b-b4f0-da274b63b7e1 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:23.490602 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-0bb53904-6b81-4126-9b16-bb1c2786a1be req-6ebcc44a-eba9-4c3b-b4f0-da274b63b7e1 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:23.503555 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-0bb53904-6b81-4126-9b16-bb1c2786a1be req-6ebcc44a-eba9-4c3b-b4f0-da274b63b7e1 service nova] Creating event network-vif-plugged:80bb11cb-f6bb-4bfd-9286-ef445e19918b for instance 42b963e7-0efb-4d43-a8af-7558d83decc6 on hv-cinder-81809 Nov 16 16:06:23.510688 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-0bb53904-6b81-4126-9b16-bb1c2786a1be req-6ebcc44a-eba9-4c3b-b4f0-da274b63b7e1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039849 Nov 16 16:06:23.511783 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 232/432] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:06:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:06:23.548742 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-33d03428-d6b7-40ab-9c8f-7e9221033cd8 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:23.549985 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-33d03428-d6b7-40ab-9c8f-7e9221033cd8 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:23.562452 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-33d03428-d6b7-40ab-9c8f-7e9221033cd8 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:23.563950 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-33d03428-d6b7-40ab-9c8f-7e9221033cd8 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:23.564785 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-33d03428-d6b7-40ab-9c8f-7e9221033cd8 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:23.565236 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-33d03428-d6b7-40ab-9c8f-7e9221033cd8 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:23.878467 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-33d03428-d6b7-40ab-9c8f-7e9221033cd8 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:23.918098 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-33d03428-d6b7-40ab-9c8f-7e9221033cd8 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1568 microversion: 2.1 time: 0.382654 Nov 16 16:06:23.919339 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 201/433] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:23 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1568 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:24.191772 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-0817fc8f-6b2d-4dd5-8e5e-5bf00efdd1d9 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:24.194146 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-0817fc8f-6b2d-4dd5-8e5e-5bf00efdd1d9 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] [instance: 42b963e7-0efb-4d43-a8af-7558d83decc6] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:24.195062 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-feca202b-2055-41e1-8689-fb1be6b209fd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:24.199318 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-feca202b-2055-41e1-8689-fb1be6b209fd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:24.211997 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0817fc8f-6b2d-4dd5-8e5e-5bf00efdd1d9 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:24.212574 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0817fc8f-6b2d-4dd5-8e5e-5bf00efdd1d9 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:24.214484 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-feca202b-2055-41e1-8689-fb1be6b209fd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:24.214998 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-feca202b-2055-41e1-8689-fb1be6b209fd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:24.215869 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0817fc8f-6b2d-4dd5-8e5e-5bf00efdd1d9 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:24.217267 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-feca202b-2055-41e1-8689-fb1be6b209fd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:24.217519 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0817fc8f-6b2d-4dd5-8e5e-5bf00efdd1d9 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:24.218084 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-feca202b-2055-41e1-8689-fb1be6b209fd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:24.470792 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-feca202b-2055-41e1-8689-fb1be6b209fd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:24.481241 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-feca202b-2055-41e1-8689-fb1be6b209fd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:24.485925 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-feca202b-2055-41e1-8689-fb1be6b209fd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:24.487744 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-feca202b-2055-41e1-8689-fb1be6b209fd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1739 microversion: 2.20 time: 0.304844 Nov 16 16:06:24.488317 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 233/434] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:06:24 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1739 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:06:24.495430 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-53523d03-4f42-4229-87c7-e7ff9a2bbdaf tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:24.496363 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-53523d03-4f42-4229-87c7-e7ff9a2bbdaf tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:24.504217 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-53523d03-4f42-4229-87c7-e7ff9a2bbdaf tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:24.506267 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-53523d03-4f42-4229-87c7-e7ff9a2bbdaf tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:24.508549 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-53523d03-4f42-4229-87c7-e7ff9a2bbdaf tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:24.509370 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-53523d03-4f42-4229-87c7-e7ff9a2bbdaf tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:24.534924 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-0817fc8f-6b2d-4dd5-8e5e-5bf00efdd1d9 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d9e7cc0fb849e8a3d067214ac3402a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e03b8724364db290573e549b643dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:24.549869 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-0817fc8f-6b2d-4dd5-8e5e-5bf00efdd1d9 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] 10.222.0.46 "GET /compute/v2.1/servers/42b963e7-0efb-4d43-a8af-7558d83decc6" status: 200 len: 1314 microversion: 2.1 time: 0.368257 Nov 16 16:06:24.555691 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 202/435] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:24 2021] GET /compute/v2.1/servers/42b963e7-0efb-4d43-a8af-7558d83decc6 => generated 1314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:24.677558 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-53523d03-4f42-4229-87c7-e7ff9a2bbdaf tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:24.686497 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-53523d03-4f42-4229-87c7-e7ff9a2bbdaf tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1720 microversion: 2.1 time: 0.195477 Nov 16 16:06:24.687403 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 234/436] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:24 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1720 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:24.936265 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-2d71600b-8350-4aab-b06c-9ef86c5ac3d3 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:24.936832 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-2d71600b-8350-4aab-b06c-9ef86c5ac3d3 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:24.944385 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2d71600b-8350-4aab-b06c-9ef86c5ac3d3 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:24.945252 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2d71600b-8350-4aab-b06c-9ef86c5ac3d3 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:24.946275 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2d71600b-8350-4aab-b06c-9ef86c5ac3d3 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:24.946928 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2d71600b-8350-4aab-b06c-9ef86c5ac3d3 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:25.092765 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-2d71600b-8350-4aab-b06c-9ef86c5ac3d3 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:25.101611 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-2d71600b-8350-4aab-b06c-9ef86c5ac3d3 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1568 microversion: 2.1 time: 0.169023 Nov 16 16:06:25.118099 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 203/437] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:24 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:25.508119 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7c6b363a-75cd-4bcd-8168-a40b403548f5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:25.508733 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-7c6b363a-75cd-4bcd-8168-a40b403548f5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:25.516297 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7c6b363a-75cd-4bcd-8168-a40b403548f5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:25.517104 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7c6b363a-75cd-4bcd-8168-a40b403548f5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:25.518285 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7c6b363a-75cd-4bcd-8168-a40b403548f5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:25.518866 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7c6b363a-75cd-4bcd-8168-a40b403548f5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:25.541526 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-490750a1-2714-4bfe-b836-d476cea70c74 req-49c92a01-0a00-454c-bb00-fe03dbb38677 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6447972e-6291-4e68-8271-c93523206230", "name": "network-vif-plugged", "status": "completed", "tag": "68ede3d7-0ef4-42a4-b3de-ef6046161db6"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:06:25.544232 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:06:25.544232 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Nov 16 16:06:25.564428 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-490750a1-2714-4bfe-b836-d476cea70c74 req-49c92a01-0a00-454c-bb00-fe03dbb38677 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:25.565193 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-490750a1-2714-4bfe-b836-d476cea70c74 req-49c92a01-0a00-454c-bb00-fe03dbb38677 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:25.577969 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-490750a1-2714-4bfe-b836-d476cea70c74 req-49c92a01-0a00-454c-bb00-fe03dbb38677 service nova] Creating event network-vif-plugged:68ede3d7-0ef4-42a4-b3de-ef6046161db6 for instance 6447972e-6291-4e68-8271-c93523206230 on hv-cinder-81809 Nov 16 16:06:25.585163 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-490750a1-2714-4bfe-b836-d476cea70c74 req-49c92a01-0a00-454c-bb00-fe03dbb38677 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048814 Nov 16 16:06:25.586046 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 204/438] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:06:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:06:25.592197 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-a8ece513-6841-4318-9539-6108230a4825 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:25.593103 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-a8ece513-6841-4318-9539-6108230a4825 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] [instance: 42b963e7-0efb-4d43-a8af-7558d83decc6] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:25.602006 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a8ece513-6841-4318-9539-6108230a4825 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:25.602665 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a8ece513-6841-4318-9539-6108230a4825 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:25.603640 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a8ece513-6841-4318-9539-6108230a4825 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:25.604270 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a8ece513-6841-4318-9539-6108230a4825 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:25.743848 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7c6b363a-75cd-4bcd-8168-a40b403548f5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:25.761399 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7c6b363a-75cd-4bcd-8168-a40b403548f5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:25.763013 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7c6b363a-75cd-4bcd-8168-a40b403548f5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:25.766713 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-7c6b363a-75cd-4bcd-8168-a40b403548f5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1739 microversion: 2.20 time: 0.263906 Nov 16 16:06:25.769429 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 235/439] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:06:25 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1739 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:06:25.777383 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-620e71d6-03f0-4130-9631-a1c7a3489422 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:25.784333 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-620e71d6-03f0-4130-9631-a1c7a3489422 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:25.796458 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-620e71d6-03f0-4130-9631-a1c7a3489422 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:25.796922 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-620e71d6-03f0-4130-9631-a1c7a3489422 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:25.797726 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-620e71d6-03f0-4130-9631-a1c7a3489422 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:25.798158 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-620e71d6-03f0-4130-9631-a1c7a3489422 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:25.894729 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-a8ece513-6841-4318-9539-6108230a4825 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d9e7cc0fb849e8a3d067214ac3402a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e03b8724364db290573e549b643dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:25.904043 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-a8ece513-6841-4318-9539-6108230a4825 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] 10.222.0.46 "GET /compute/v2.1/servers/42b963e7-0efb-4d43-a8af-7558d83decc6" status: 200 len: 1499 microversion: 2.1 time: 0.316641 Nov 16 16:06:25.916140 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 205/440] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:25 2021] GET /compute/v2.1/servers/42b963e7-0efb-4d43-a8af-7558d83decc6 => generated 1499 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:25.990571 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-620e71d6-03f0-4130-9631-a1c7a3489422 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:26.005618 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-620e71d6-03f0-4130-9631-a1c7a3489422 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1720 microversion: 2.1 time: 0.227359 Nov 16 16:06:26.006592 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 236/441] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:25 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1720 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:26.118972 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-cc28a287-b6dd-4d47-bcc9-45e06236a624 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:26.120630 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-cc28a287-b6dd-4d47-bcc9-45e06236a624 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:26.130146 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cc28a287-b6dd-4d47-bcc9-45e06236a624 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:26.131203 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cc28a287-b6dd-4d47-bcc9-45e06236a624 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:26.132543 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cc28a287-b6dd-4d47-bcc9-45e06236a624 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:26.133397 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cc28a287-b6dd-4d47-bcc9-45e06236a624 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:26.304995 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-cc28a287-b6dd-4d47-bcc9-45e06236a624 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:26.314752 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-cc28a287-b6dd-4d47-bcc9-45e06236a624 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1568 microversion: 2.1 time: 0.199604 Nov 16 16:06:26.315328 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 206/442] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:26 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1568 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:26.752414 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e8ddb412-c66e-4919-aa2f-1ca2631c55ee tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:26.753538 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e8ddb412-c66e-4919-aa2f-1ca2631c55ee tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] [instance: 42b963e7-0efb-4d43-a8af-7558d83decc6] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:26.762767 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e8ddb412-c66e-4919-aa2f-1ca2631c55ee tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:26.763219 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e8ddb412-c66e-4919-aa2f-1ca2631c55ee tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:26.764041 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e8ddb412-c66e-4919-aa2f-1ca2631c55ee tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:26.764473 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e8ddb412-c66e-4919-aa2f-1ca2631c55ee tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:26.790821 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-21275116-e664-445a-885e-d1ada229815c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:26.791689 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-21275116-e664-445a-885e-d1ada229815c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:26.802368 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-21275116-e664-445a-885e-d1ada229815c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:26.802955 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-21275116-e664-445a-885e-d1ada229815c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:26.803816 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-21275116-e664-445a-885e-d1ada229815c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:26.811732 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-21275116-e664-445a-885e-d1ada229815c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:26.816349 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e8ddb412-c66e-4919-aa2f-1ca2631c55ee tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] [instance: 42b963e7-0efb-4d43-a8af-7558d83decc6] Going to try to terminate instance {{(pid=116084) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 16:06:26.936861 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e8ddb412-c66e-4919-aa2f-1ca2631c55ee tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] 10.222.0.46 "DELETE /compute/v2.1/servers/42b963e7-0efb-4d43-a8af-7558d83decc6" status: 204 len: 0 microversion: 2.1 time: 0.187091 Nov 16 16:06:26.939446 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 237/443] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 16 16:06:26 2021] DELETE /compute/v2.1/servers/42b963e7-0efb-4d43-a8af-7558d83decc6 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 16 16:06:26.951763 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-5cdd3401-0a7e-451c-826f-cb6bd41cb7ec tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:26.954368 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-5cdd3401-0a7e-451c-826f-cb6bd41cb7ec tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] [instance: 42b963e7-0efb-4d43-a8af-7558d83decc6] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:26.968578 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5cdd3401-0a7e-451c-826f-cb6bd41cb7ec tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:26.969429 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5cdd3401-0a7e-451c-826f-cb6bd41cb7ec tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:26.971107 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5cdd3401-0a7e-451c-826f-cb6bd41cb7ec tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:26.972049 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5cdd3401-0a7e-451c-826f-cb6bd41cb7ec tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:27.059945 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-21275116-e664-445a-885e-d1ada229815c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:27.073040 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-21275116-e664-445a-885e-d1ada229815c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:27.075483 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-21275116-e664-445a-885e-d1ada229815c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:27.077453 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-21275116-e664-445a-885e-d1ada229815c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1739 microversion: 2.20 time: 0.293339 Nov 16 16:06:27.095444 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 207/444] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:06:26 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1739 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:06:27.104671 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-631f190e-0313-4423-abb4-e5570e68d5ba tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:27.105491 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-631f190e-0313-4423-abb4-e5570e68d5ba tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:27.112010 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-631f190e-0313-4423-abb4-e5570e68d5ba tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:27.112642 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-631f190e-0313-4423-abb4-e5570e68d5ba tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:27.113592 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-631f190e-0313-4423-abb4-e5570e68d5ba tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:27.114700 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-631f190e-0313-4423-abb4-e5570e68d5ba tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:27.183067 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-5cdd3401-0a7e-451c-826f-cb6bd41cb7ec tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d9e7cc0fb849e8a3d067214ac3402a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e03b8724364db290573e549b643dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:27.190851 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-5cdd3401-0a7e-451c-826f-cb6bd41cb7ec tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] 10.222.0.46 "GET /compute/v2.1/servers/42b963e7-0efb-4d43-a8af-7558d83decc6" status: 200 len: 1505 microversion: 2.1 time: 0.246394 Nov 16 16:06:27.197257 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 238/445] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:26 2021] GET /compute/v2.1/servers/42b963e7-0efb-4d43-a8af-7558d83decc6 => generated 1505 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:27.315077 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-631f190e-0313-4423-abb4-e5570e68d5ba tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:27.326099 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-631f190e-0313-4423-abb4-e5570e68d5ba tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1720 microversion: 2.1 time: 0.229223 Nov 16 16:06:27.331803 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f6a907bb-d9d5-4f28-be11-064546465ca0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:27.332756 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f6a907bb-d9d5-4f28-be11-064546465ca0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:27.338199 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 208/446] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:27 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1720 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:27.340076 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f6a907bb-d9d5-4f28-be11-064546465ca0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:27.340773 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f6a907bb-d9d5-4f28-be11-064546465ca0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:27.341768 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f6a907bb-d9d5-4f28-be11-064546465ca0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:27.342206 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f6a907bb-d9d5-4f28-be11-064546465ca0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:27.492819 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f6a907bb-d9d5-4f28-be11-064546465ca0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:27.501171 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f6a907bb-d9d5-4f28-be11-064546465ca0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1568 microversion: 2.1 time: 0.173345 Nov 16 16:06:27.511602 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 239/447] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:27 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:06:28.095194 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-a0067bab-3cd0-450d-a52f-f06fa88a375c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:28.095829 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-a0067bab-3cd0-450d-a52f-f06fa88a375c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:28.106291 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a0067bab-3cd0-450d-a52f-f06fa88a375c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:28.106769 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a0067bab-3cd0-450d-a52f-f06fa88a375c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:28.107552 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a0067bab-3cd0-450d-a52f-f06fa88a375c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:28.107989 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a0067bab-3cd0-450d-a52f-f06fa88a375c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:28.212238 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3bdc3d9e-25eb-4fe6-a803-8b96c6ed31f2 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:28.213805 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-3bdc3d9e-25eb-4fe6-a803-8b96c6ed31f2 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] [instance: 42b963e7-0efb-4d43-a8af-7558d83decc6] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:28.228084 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3bdc3d9e-25eb-4fe6-a803-8b96c6ed31f2 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:28.229707 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3bdc3d9e-25eb-4fe6-a803-8b96c6ed31f2 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:28.230915 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3bdc3d9e-25eb-4fe6-a803-8b96c6ed31f2 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:28.232362 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3bdc3d9e-25eb-4fe6-a803-8b96c6ed31f2 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:28.398054 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-a0067bab-3cd0-450d-a52f-f06fa88a375c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:28.415137 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-a0067bab-3cd0-450d-a52f-f06fa88a375c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:28.416795 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-a0067bab-3cd0-450d-a52f-f06fa88a375c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:28.419393 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-a0067bab-3cd0-450d-a52f-f06fa88a375c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1739 microversion: 2.20 time: 0.327892 Nov 16 16:06:28.421087 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 209/448] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:06:28 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1739 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:06:28.437829 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-57b8d3df-c28c-429f-bccc-87b81565d04b tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:28.440750 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-57b8d3df-c28c-429f-bccc-87b81565d04b tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:28.454148 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-57b8d3df-c28c-429f-bccc-87b81565d04b tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:28.455858 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-57b8d3df-c28c-429f-bccc-87b81565d04b tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:28.457326 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-57b8d3df-c28c-429f-bccc-87b81565d04b tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:28.463853 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-57b8d3df-c28c-429f-bccc-87b81565d04b tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:28.593270 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-3bdc3d9e-25eb-4fe6-a803-8b96c6ed31f2 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d9e7cc0fb849e8a3d067214ac3402a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e03b8724364db290573e549b643dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:28.606538 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-3bdc3d9e-25eb-4fe6-a803-8b96c6ed31f2 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] 10.222.0.46 "GET /compute/v2.1/servers/42b963e7-0efb-4d43-a8af-7558d83decc6" status: 200 len: 1505 microversion: 2.1 time: 0.399156 Nov 16 16:06:28.608262 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 240/449] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:28 2021] GET /compute/v2.1/servers/42b963e7-0efb-4d43-a8af-7558d83decc6 => generated 1505 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:28.620569 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f8c59110-439d-4a4e-bcf1-36d41b6cf0da tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:28.625218 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f8c59110-439d-4a4e-bcf1-36d41b6cf0da tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:28.640694 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f8c59110-439d-4a4e-bcf1-36d41b6cf0da tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:28.642702 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f8c59110-439d-4a4e-bcf1-36d41b6cf0da tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:28.644763 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f8c59110-439d-4a4e-bcf1-36d41b6cf0da tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:28.646903 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f8c59110-439d-4a4e-bcf1-36d41b6cf0da tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:28.736097 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-57b8d3df-c28c-429f-bccc-87b81565d04b tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:28.752304 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-57b8d3df-c28c-429f-bccc-87b81565d04b tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1697 microversion: 2.1 time: 0.329895 Nov 16 16:06:28.752890 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 210/450] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:28 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1697 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:28.770912 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-fd70a1e7-482d-46bb-b0d8-720c22cf19e4 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:06:28.781777 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fd70a1e7-482d-46bb-b0d8-720c22cf19e4 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:28.783094 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fd70a1e7-482d-46bb-b0d8-720c22cf19e4 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:28.896940 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-fd70a1e7-482d-46bb-b0d8-720c22cf19e4 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Going to try to start instance {{(pid=116085) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 16 16:06:28.903939 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f8c59110-439d-4a4e-bcf1-36d41b6cf0da tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:28.915886 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f8c59110-439d-4a4e-bcf1-36d41b6cf0da tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1568 microversion: 2.1 time: 0.304810 Nov 16 16:06:28.927687 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 241/451] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:28 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1568 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:28.993266 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-fd70a1e7-482d-46bb-b0d8-720c22cf19e4 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action" status: 202 len: 0 microversion: 2.1 time: 0.226584 Nov 16 16:06:28.993890 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 211/452] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:06:28 2021] POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:06:29.003389 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-98cd82fd-c265-4d9e-84e6-cae6bfab55d4 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:29.004098 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-98cd82fd-c265-4d9e-84e6-cae6bfab55d4 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:29.011904 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-98cd82fd-c265-4d9e-84e6-cae6bfab55d4 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:29.012588 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-98cd82fd-c265-4d9e-84e6-cae6bfab55d4 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:29.013638 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-98cd82fd-c265-4d9e-84e6-cae6bfab55d4 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:29.014238 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-98cd82fd-c265-4d9e-84e6-cae6bfab55d4 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:29.266213 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-98cd82fd-c265-4d9e-84e6-cae6bfab55d4 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:29.303901 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-98cd82fd-c265-4d9e-84e6-cae6bfab55d4 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1706 microversion: 2.1 time: 0.305586 Nov 16 16:06:29.307677 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 242/453] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:28 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1706 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:29.439720 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-79086b50-39b1-4d7e-968f-34cfe947f268 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:29.440212 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-79086b50-39b1-4d7e-968f-34cfe947f268 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:29.454481 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-79086b50-39b1-4d7e-968f-34cfe947f268 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:29.454925 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-79086b50-39b1-4d7e-968f-34cfe947f268 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:29.465228 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-79086b50-39b1-4d7e-968f-34cfe947f268 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:29.466051 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-79086b50-39b1-4d7e-968f-34cfe947f268 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:29.627930 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-5686bbcd-4262-41c3-a87b-cbcc89cf8875 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:29.629065 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-5686bbcd-4262-41c3-a87b-cbcc89cf8875 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] [instance: 42b963e7-0efb-4d43-a8af-7558d83decc6] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:29.653823 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5686bbcd-4262-41c3-a87b-cbcc89cf8875 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:29.654512 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5686bbcd-4262-41c3-a87b-cbcc89cf8875 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:29.655892 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5686bbcd-4262-41c3-a87b-cbcc89cf8875 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:29.656412 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5686bbcd-4262-41c3-a87b-cbcc89cf8875 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:29.777828 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-5686bbcd-4262-41c3-a87b-cbcc89cf8875 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d9e7cc0fb849e8a3d067214ac3402a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e03b8724364db290573e549b643dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:29.795087 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-5686bbcd-4262-41c3-a87b-cbcc89cf8875 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] 10.222.0.46 "GET /compute/v2.1/servers/42b963e7-0efb-4d43-a8af-7558d83decc6" status: 200 len: 1463 microversion: 2.1 time: 0.170994 Nov 16 16:06:29.796414 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 243/454] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:29 2021] GET /compute/v2.1/servers/42b963e7-0efb-4d43-a8af-7558d83decc6 => generated 1463 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:29.870289 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-79086b50-39b1-4d7e-968f-34cfe947f268 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:29.883109 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-bdf45f6d-92d9-448f-981d-7c1d92a833a5 req-7159eadb-63d4-46ff-8366-b0441277d73f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42b963e7-0efb-4d43-a8af-7558d83decc6", "name": "network-vif-deleted", "tag": "80bb11cb-f6bb-4bfd-9286-ef445e19918b"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:06:29.885064 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:06:29.885064 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Nov 16 16:06:29.896409 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-79086b50-39b1-4d7e-968f-34cfe947f268 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:29.898596 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-79086b50-39b1-4d7e-968f-34cfe947f268 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:29.902059 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-79086b50-39b1-4d7e-968f-34cfe947f268 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1739 microversion: 2.20 time: 0.467578 Nov 16 16:06:29.903447 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 212/455] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:06:29 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1739 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:06:29.906514 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-bdf45f6d-92d9-448f-981d-7c1d92a833a5 req-7159eadb-63d4-46ff-8366-b0441277d73f service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:29.906967 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-bdf45f6d-92d9-448f-981d-7c1d92a833a5 req-7159eadb-63d4-46ff-8366-b0441277d73f service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:29.924657 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-bdf45f6d-92d9-448f-981d-7c1d92a833a5 req-7159eadb-63d4-46ff-8366-b0441277d73f service nova] Creating event network-vif-deleted:80bb11cb-f6bb-4bfd-9286-ef445e19918b for instance 42b963e7-0efb-4d43-a8af-7558d83decc6 on hv-cinder-81809 Nov 16 16:06:29.934214 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-272b41ad-b9c0-48a2-ba3d-b03bb81439cd tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:29.935083 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-272b41ad-b9c0-48a2-ba3d-b03bb81439cd tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:29.945332 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-bdf45f6d-92d9-448f-981d-7c1d92a833a5 req-7159eadb-63d4-46ff-8366-b0441277d73f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067365 Nov 16 16:06:29.946130 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-272b41ad-b9c0-48a2-ba3d-b03bb81439cd tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:29.946862 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-272b41ad-b9c0-48a2-ba3d-b03bb81439cd tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:29.947628 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 244/456] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:06:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:06:29.948862 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-272b41ad-b9c0-48a2-ba3d-b03bb81439cd tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:29.966023 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-272b41ad-b9c0-48a2-ba3d-b03bb81439cd tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:30.261650 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-272b41ad-b9c0-48a2-ba3d-b03bb81439cd tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:30.273892 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-272b41ad-b9c0-48a2-ba3d-b03bb81439cd tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1568 microversion: 2.1 time: 0.343571 Nov 16 16:06:30.275247 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 213/457] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:29 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1568 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:06:30.326524 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-60e98cd2-0397-4638-81ba-4fb122b0e748 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:30.327781 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-60e98cd2-0397-4638-81ba-4fb122b0e748 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:30.339237 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-60e98cd2-0397-4638-81ba-4fb122b0e748 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:30.341267 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-60e98cd2-0397-4638-81ba-4fb122b0e748 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:30.343583 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-60e98cd2-0397-4638-81ba-4fb122b0e748 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:30.345021 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-60e98cd2-0397-4638-81ba-4fb122b0e748 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:30.664921 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-60e98cd2-0397-4638-81ba-4fb122b0e748 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:30.673915 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-60e98cd2-0397-4638-81ba-4fb122b0e748 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1706 microversion: 2.1 time: 0.351954 Nov 16 16:06:30.686334 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 245/458] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:30 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1706 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:30.813641 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-04419e73-fd48-400e-9562-ea3c310a27c2 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:30.814456 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-04419e73-fd48-400e-9562-ea3c310a27c2 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] [instance: 42b963e7-0efb-4d43-a8af-7558d83decc6] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:30.822388 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-04419e73-fd48-400e-9562-ea3c310a27c2 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:30.823255 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-04419e73-fd48-400e-9562-ea3c310a27c2 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:30.824279 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-04419e73-fd48-400e-9562-ea3c310a27c2 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:30.824904 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-04419e73-fd48-400e-9562-ea3c310a27c2 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:30.840985 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.wsgi [None req-04419e73-fd48-400e-9562-ea3c310a27c2 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] HTTP exception thrown: Instance 42b963e7-0efb-4d43-a8af-7558d83decc6 could not be found. Nov 16 16:06:30.841589 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-04419e73-fd48-400e-9562-ea3c310a27c2 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] Returning 404 to user: Instance 42b963e7-0efb-4d43-a8af-7558d83decc6 could not be found. {{(pid=116085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:06:30.842440 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-04419e73-fd48-400e-9562-ea3c310a27c2 tempest-VolumesActionsTest-461093963 tempest-VolumesActionsTest-461093963-project] 10.222.0.46 "GET /compute/v2.1/servers/42b963e7-0efb-4d43-a8af-7558d83decc6" status: 404 len: 111 microversion: 2.1 time: 0.032447 Nov 16 16:06:30.847801 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 214/459] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:30 2021] GET /compute/v2.1/servers/42b963e7-0efb-4d43-a8af-7558d83decc6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:06:30.922266 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0022a61a-cae5-4e2f-a2b1-ac933bdbb2e2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:30.923034 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0022a61a-cae5-4e2f-a2b1-ac933bdbb2e2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:30.930018 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0022a61a-cae5-4e2f-a2b1-ac933bdbb2e2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:30.932688 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0022a61a-cae5-4e2f-a2b1-ac933bdbb2e2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:30.935229 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0022a61a-cae5-4e2f-a2b1-ac933bdbb2e2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:30.935807 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0022a61a-cae5-4e2f-a2b1-ac933bdbb2e2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:31.235099 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0022a61a-cae5-4e2f-a2b1-ac933bdbb2e2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:31.247920 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0022a61a-cae5-4e2f-a2b1-ac933bdbb2e2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:31.251806 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0022a61a-cae5-4e2f-a2b1-ac933bdbb2e2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:31.256203 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0022a61a-cae5-4e2f-a2b1-ac933bdbb2e2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1739 microversion: 2.20 time: 0.338620 Nov 16 16:06:31.257122 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 246/460] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:06:30 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1739 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:06:31.303561 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-f6e66b0d-ce1e-4b98-9493-2e33dff1c429 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:31.303561 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-f6e66b0d-ce1e-4b98-9493-2e33dff1c429 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:31.316178 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f6e66b0d-ce1e-4b98-9493-2e33dff1c429 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:31.326723 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f6e66b0d-ce1e-4b98-9493-2e33dff1c429 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:31.331448 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f6e66b0d-ce1e-4b98-9493-2e33dff1c429 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:31.348440 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f6e66b0d-ce1e-4b98-9493-2e33dff1c429 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:31.671634 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-f6e66b0d-ce1e-4b98-9493-2e33dff1c429 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:31.694378 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-474e8b87-fa71-4d6f-a901-37d2d36a0b0d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:31.695599 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-474e8b87-fa71-4d6f-a901-37d2d36a0b0d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:31.697904 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-f6e66b0d-ce1e-4b98-9493-2e33dff1c429 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1568 microversion: 2.1 time: 0.403749 Nov 16 16:06:31.701838 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 215/461] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:31 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1568 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:31.707994 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-474e8b87-fa71-4d6f-a901-37d2d36a0b0d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:31.708712 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-474e8b87-fa71-4d6f-a901-37d2d36a0b0d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:31.711288 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-474e8b87-fa71-4d6f-a901-37d2d36a0b0d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:31.712897 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-474e8b87-fa71-4d6f-a901-37d2d36a0b0d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:31.985792 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-474e8b87-fa71-4d6f-a901-37d2d36a0b0d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:31.995880 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-474e8b87-fa71-4d6f-a901-37d2d36a0b0d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1710 microversion: 2.1 time: 0.306271 Nov 16 16:06:31.997100 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 247/462] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:31 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1710 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:06:32.289510 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-4582ff93-377b-423d-ae84-02de636aaccc tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:32.293663 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-4582ff93-377b-423d-ae84-02de636aaccc tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:32.316687 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4582ff93-377b-423d-ae84-02de636aaccc tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:32.317287 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4582ff93-377b-423d-ae84-02de636aaccc tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:32.318136 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4582ff93-377b-423d-ae84-02de636aaccc tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:32.318573 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4582ff93-377b-423d-ae84-02de636aaccc tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:32.547385 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-4582ff93-377b-423d-ae84-02de636aaccc tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:32.588808 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-4582ff93-377b-423d-ae84-02de636aaccc tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:32.592457 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-4582ff93-377b-423d-ae84-02de636aaccc tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:32.599685 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-4582ff93-377b-423d-ae84-02de636aaccc tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1739 microversion: 2.20 time: 0.316302 Nov 16 16:06:32.618592 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 216/463] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:06:32 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1739 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:06:32.736579 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-4fef6a59-c452-4a10-b845-8f1d1e147117 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:32.737794 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-4fef6a59-c452-4a10-b845-8f1d1e147117 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:32.744883 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4fef6a59-c452-4a10-b845-8f1d1e147117 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:32.745740 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4fef6a59-c452-4a10-b845-8f1d1e147117 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:32.747222 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4fef6a59-c452-4a10-b845-8f1d1e147117 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:32.747920 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4fef6a59-c452-4a10-b845-8f1d1e147117 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:32.938495 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-4fef6a59-c452-4a10-b845-8f1d1e147117 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:32.949363 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-4fef6a59-c452-4a10-b845-8f1d1e147117 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1568 microversion: 2.1 time: 0.216274 Nov 16 16:06:32.952732 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 248/464] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:32 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1568 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:33.637340 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-f1f052b2-a78e-48b6-9eab-56f2403d2cec tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:33.638706 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-f1f052b2-a78e-48b6-9eab-56f2403d2cec tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:33.654226 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f1f052b2-a78e-48b6-9eab-56f2403d2cec tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:33.654742 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f1f052b2-a78e-48b6-9eab-56f2403d2cec tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:33.655646 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f1f052b2-a78e-48b6-9eab-56f2403d2cec tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:33.656282 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f1f052b2-a78e-48b6-9eab-56f2403d2cec tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:33.881728 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-f1f052b2-a78e-48b6-9eab-56f2403d2cec tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:33.898147 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-f1f052b2-a78e-48b6-9eab-56f2403d2cec tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:33.900873 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-f1f052b2-a78e-48b6-9eab-56f2403d2cec tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:33.903027 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-f1f052b2-a78e-48b6-9eab-56f2403d2cec tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1739 microversion: 2.20 time: 0.269241 Nov 16 16:06:33.903696 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 217/465] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:06:33 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1739 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:06:33.981052 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-cd063bce-45d7-4d7c-9053-a9ca336483c1 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:33.982358 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-cd063bce-45d7-4d7c-9053-a9ca336483c1 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:33.990415 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cd063bce-45d7-4d7c-9053-a9ca336483c1 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:33.991266 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cd063bce-45d7-4d7c-9053-a9ca336483c1 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:33.992498 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cd063bce-45d7-4d7c-9053-a9ca336483c1 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:33.993150 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cd063bce-45d7-4d7c-9053-a9ca336483c1 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:34.238493 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-cd063bce-45d7-4d7c-9053-a9ca336483c1 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:34.247790 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-cd063bce-45d7-4d7c-9053-a9ca336483c1 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1568 microversion: 2.1 time: 0.277673 Nov 16 16:06:34.248372 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 249/466] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:33 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1568 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:34.920958 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-c31a8184-d23e-4043-aa5e-4c5f4bb5f5e0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:34.921574 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-c31a8184-d23e-4043-aa5e-4c5f4bb5f5e0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:34.928703 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c31a8184-d23e-4043-aa5e-4c5f4bb5f5e0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:34.929144 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c31a8184-d23e-4043-aa5e-4c5f4bb5f5e0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:34.929912 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c31a8184-d23e-4043-aa5e-4c5f4bb5f5e0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:34.930337 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c31a8184-d23e-4043-aa5e-4c5f4bb5f5e0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:35.075511 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-c31a8184-d23e-4043-aa5e-4c5f4bb5f5e0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:35.085076 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-c31a8184-d23e-4043-aa5e-4c5f4bb5f5e0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:35.086556 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-c31a8184-d23e-4043-aa5e-4c5f4bb5f5e0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:35.087743 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-c31a8184-d23e-4043-aa5e-4c5f4bb5f5e0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1739 microversion: 2.20 time: 0.170435 Nov 16 16:06:35.088302 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 218/467] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:06:34 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:06:35.265328 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c7388e49-4190-4983-a7f2-6c82a365ea92 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:35.265926 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c7388e49-4190-4983-a7f2-6c82a365ea92 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:35.273067 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c7388e49-4190-4983-a7f2-6c82a365ea92 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:35.273507 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c7388e49-4190-4983-a7f2-6c82a365ea92 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:35.274291 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c7388e49-4190-4983-a7f2-6c82a365ea92 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:35.274699 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c7388e49-4190-4983-a7f2-6c82a365ea92 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:35.407041 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-c7388e49-4190-4983-a7f2-6c82a365ea92 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:35.415848 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c7388e49-4190-4983-a7f2-6c82a365ea92 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1568 microversion: 2.1 time: 0.154283 Nov 16 16:06:35.416423 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 250/468] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:35 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:36.105886 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-fb6ce7d7-de56-4d69-ad59-5d7681fcb5f6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:36.106518 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-fb6ce7d7-de56-4d69-ad59-5d7681fcb5f6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:36.112744 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fb6ce7d7-de56-4d69-ad59-5d7681fcb5f6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:36.113180 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fb6ce7d7-de56-4d69-ad59-5d7681fcb5f6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:36.115085 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fb6ce7d7-de56-4d69-ad59-5d7681fcb5f6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:36.115553 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fb6ce7d7-de56-4d69-ad59-5d7681fcb5f6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:36.304779 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-fb6ce7d7-de56-4d69-ad59-5d7681fcb5f6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:36.319160 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-fb6ce7d7-de56-4d69-ad59-5d7681fcb5f6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:36.320683 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-fb6ce7d7-de56-4d69-ad59-5d7681fcb5f6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:36.321838 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-fb6ce7d7-de56-4d69-ad59-5d7681fcb5f6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1721 microversion: 2.20 time: 0.219667 Nov 16 16:06:36.322393 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 219/469] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:06:36 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1721 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:06:36.433151 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e25bfd20-4ca1-4f9c-b402-e677a7ab5e75 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:36.434328 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e25bfd20-4ca1-4f9c-b402-e677a7ab5e75 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:36.444162 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e25bfd20-4ca1-4f9c-b402-e677a7ab5e75 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:36.444479 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e25bfd20-4ca1-4f9c-b402-e677a7ab5e75 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:36.445273 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e25bfd20-4ca1-4f9c-b402-e677a7ab5e75 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:36.445704 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e25bfd20-4ca1-4f9c-b402-e677a7ab5e75 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:36.680451 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-038d1da9-e03e-48f9-ba1b-6e3f343d4e54 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-692809983", "imageRef": "7c3bd8e0-8d7e-4cf7-90db-742c4f55e405", "flavorRef": "452", "networks": [{"uuid": "db4f0bf1-384b-4186-b414-f554b98403a2"}]}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:06:36.686455 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e25bfd20-4ca1-4f9c-b402-e677a7ab5e75 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:36.694561 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e25bfd20-4ca1-4f9c-b402-e677a7ab5e75 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1568 microversion: 2.1 time: 0.265147 Nov 16 16:06:36.695130 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 251/470] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:36 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1568 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:06:36.759034 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.network.neutron [None req-038d1da9-e03e-48f9-ba1b-6e3f343d4e54 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] validate_networks() for [('db4f0bf1-384b-4186-b414-f554b98403a2', None, None, None, None, None)] {{(pid=116085) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 16:06:37.158452 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-038d1da9-e03e-48f9-ba1b-6e3f343d4e54 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Flavor limits 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 16:06:37.159142 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-038d1da9-e03e-48f9-ba1b-6e3f343d4e54 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Image limits 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 16:06:37.159408 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-038d1da9-e03e-48f9-ba1b-6e3f343d4e54 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Flavor pref 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 16:06:37.159797 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-038d1da9-e03e-48f9-ba1b-6e3f343d4e54 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Image pref 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 16:06:37.160896 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-038d1da9-e03e-48f9-ba1b-6e3f343d4e54 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 16:06:37.172085 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-038d1da9-e03e-48f9-ba1b-6e3f343d4e54 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:37.172823 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-038d1da9-e03e-48f9-ba1b-6e3f343d4e54 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:37.174081 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-038d1da9-e03e-48f9-ba1b-6e3f343d4e54 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:37.174752 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-038d1da9-e03e-48f9-ba1b-6e3f343d4e54 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:37.193023 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-038d1da9-e03e-48f9-ba1b-6e3f343d4e54 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Getting quotas for project 218bf6ebc44c444e911ba343e1c14785. Resources: {'instances', 'ram', 'cores'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:06:37.199335 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-038d1da9-e03e-48f9-ba1b-6e3f343d4e54 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Getting quotas for user 5c4fcb8d8c3d490e915fe9583f70cb2b and project 218bf6ebc44c444e911ba343e1c14785. Resources: {'instances', 'ram', 'cores'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:06:37.215869 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-038d1da9-e03e-48f9-ba1b-6e3f343d4e54 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Going to run 1 instances... {{(pid=116085) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 16:06:37.219194 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-038d1da9-e03e-48f9-ba1b-6e3f343d4e54 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] [instance: be30cc01-fa20-42f1-80d2-a8becb9a7e2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c3bd8e0-8d7e-4cf7-90db-742c4f55e405',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116085) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 16:06:37.277792 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-038d1da9-e03e-48f9-ba1b-6e3f343d4e54 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.601686 Nov 16 16:06:37.283884 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 220/471] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 16 16:06:36 2021] POST /compute/v2.1/servers => generated 380 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 16 16:06:37.290619 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ac6f40e8-1a27-4823-bd83-e6667f9e8921 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:37.291268 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ac6f40e8-1a27-4823-bd83-e6667f9e8921 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] [instance: be30cc01-fa20-42f1-80d2-a8becb9a7e2f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:37.346605 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-b784b928-d447-4f74-bc47-4d7e3a347360 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:37.347776 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-b784b928-d447-4f74-bc47-4d7e3a347360 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:37.358925 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b784b928-d447-4f74-bc47-4d7e3a347360 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:37.371405 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b784b928-d447-4f74-bc47-4d7e3a347360 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:37.372465 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b784b928-d447-4f74-bc47-4d7e3a347360 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:37.373132 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b784b928-d447-4f74-bc47-4d7e3a347360 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:37.389836 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ac6f40e8-1a27-4823-bd83-e6667f9e8921 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fcb8d8c3d490e915fe9583f70cb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bf6ebc44c444e911ba343e1c14785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:37.400634 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ac6f40e8-1a27-4823-bd83-e6667f9e8921 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] 10.222.0.46 "GET /compute/v2.1/servers/be30cc01-fa20-42f1-80d2-a8becb9a7e2f" status: 200 len: 1218 microversion: 2.1 time: 0.115015 Nov 16 16:06:37.401790 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 252/472] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:37 2021] GET /compute/v2.1/servers/be30cc01-fa20-42f1-80d2-a8becb9a7e2f => generated 1218 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:37.564933 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-b784b928-d447-4f74-bc47-4d7e3a347360 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:37.576195 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-b784b928-d447-4f74-bc47-4d7e3a347360 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:37.578166 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-b784b928-d447-4f74-bc47-4d7e3a347360 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:37.580268 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-b784b928-d447-4f74-bc47-4d7e3a347360 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1721 microversion: 2.20 time: 0.240583 Nov 16 16:06:37.593959 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 221/473] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:06:37 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1721 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:06:37.713263 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f78716f6-b010-4079-95ef-6dd349e7f093 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:37.714029 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f78716f6-b010-4079-95ef-6dd349e7f093 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:37.735564 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f78716f6-b010-4079-95ef-6dd349e7f093 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:37.735564 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f78716f6-b010-4079-95ef-6dd349e7f093 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:37.735564 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f78716f6-b010-4079-95ef-6dd349e7f093 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:37.735564 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f78716f6-b010-4079-95ef-6dd349e7f093 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:37.945495 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f78716f6-b010-4079-95ef-6dd349e7f093 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:37.956164 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f78716f6-b010-4079-95ef-6dd349e7f093 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1568 microversion: 2.1 time: 0.248723 Nov 16 16:06:37.969743 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 253/474] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:37 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1568 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:38.421533 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-7f3e44cc-14e0-43a5-ad48-d536cadffb6c tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:38.423948 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-7f3e44cc-14e0-43a5-ad48-d536cadffb6c tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] [instance: be30cc01-fa20-42f1-80d2-a8becb9a7e2f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:38.435529 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7f3e44cc-14e0-43a5-ad48-d536cadffb6c tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:38.435901 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7f3e44cc-14e0-43a5-ad48-d536cadffb6c tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:38.436679 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7f3e44cc-14e0-43a5-ad48-d536cadffb6c tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:38.437102 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7f3e44cc-14e0-43a5-ad48-d536cadffb6c tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:38.538728 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-7f3e44cc-14e0-43a5-ad48-d536cadffb6c tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fcb8d8c3d490e915fe9583f70cb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bf6ebc44c444e911ba343e1c14785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:38.546862 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-7f3e44cc-14e0-43a5-ad48-d536cadffb6c tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] 10.222.0.46 "GET /compute/v2.1/servers/be30cc01-fa20-42f1-80d2-a8becb9a7e2f" status: 200 len: 1270 microversion: 2.1 time: 0.131347 Nov 16 16:06:38.547481 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 222/475] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:38 2021] GET /compute/v2.1/servers/be30cc01-fa20-42f1-80d2-a8becb9a7e2f => generated 1270 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:38.602032 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-814dd0f1-2e5c-4f14-a849-8daa52a4632b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:38.603033 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-814dd0f1-2e5c-4f14-a849-8daa52a4632b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:38.609650 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-814dd0f1-2e5c-4f14-a849-8daa52a4632b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:38.610233 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-814dd0f1-2e5c-4f14-a849-8daa52a4632b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:38.611107 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-814dd0f1-2e5c-4f14-a849-8daa52a4632b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:38.611859 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-814dd0f1-2e5c-4f14-a849-8daa52a4632b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:38.977662 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-b6e70d1a-f077-454f-ac95-ce75ea729367 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:38.978480 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-b6e70d1a-f077-454f-ac95-ce75ea729367 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:38.985490 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b6e70d1a-f077-454f-ac95-ce75ea729367 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:38.986369 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b6e70d1a-f077-454f-ac95-ce75ea729367 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:38.987626 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b6e70d1a-f077-454f-ac95-ce75ea729367 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:38.988827 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b6e70d1a-f077-454f-ac95-ce75ea729367 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:39.036261 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-814dd0f1-2e5c-4f14-a849-8daa52a4632b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:39.045507 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-814dd0f1-2e5c-4f14-a849-8daa52a4632b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:39.047276 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-814dd0f1-2e5c-4f14-a849-8daa52a4632b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:39.048819 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-814dd0f1-2e5c-4f14-a849-8daa52a4632b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1721 microversion: 2.20 time: 0.452140 Nov 16 16:06:39.049862 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 254/476] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:06:38 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1721 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:06:39.261135 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-b6e70d1a-f077-454f-ac95-ce75ea729367 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:39.281983 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-b6e70d1a-f077-454f-ac95-ce75ea729367 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1568 microversion: 2.1 time: 0.309059 Nov 16 16:06:39.294503 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 223/477] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:38 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1568 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:06:39.612036 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-43eb3e0c-6a2c-473f-bf5c-c414485eed84 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:39.614164 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-43eb3e0c-6a2c-473f-bf5c-c414485eed84 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] [instance: be30cc01-fa20-42f1-80d2-a8becb9a7e2f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:39.651676 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-43eb3e0c-6a2c-473f-bf5c-c414485eed84 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:39.669134 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-43eb3e0c-6a2c-473f-bf5c-c414485eed84 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:39.672550 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-43eb3e0c-6a2c-473f-bf5c-c414485eed84 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:39.675372 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-43eb3e0c-6a2c-473f-bf5c-c414485eed84 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:40.068901 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-8769202e-d520-492d-9835-7c6c6cac04f9 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:40.070209 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-8769202e-d520-492d-9835-7c6c6cac04f9 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:40.077120 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8769202e-d520-492d-9835-7c6c6cac04f9 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:40.077630 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8769202e-d520-492d-9835-7c6c6cac04f9 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:40.078496 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8769202e-d520-492d-9835-7c6c6cac04f9 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:40.079079 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8769202e-d520-492d-9835-7c6c6cac04f9 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:40.412752 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-43eb3e0c-6a2c-473f-bf5c-c414485eed84 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fcb8d8c3d490e915fe9583f70cb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bf6ebc44c444e911ba343e1c14785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:40.421096 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-43eb3e0c-6a2c-473f-bf5c-c414485eed84 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] 10.222.0.46 "GET /compute/v2.1/servers/be30cc01-fa20-42f1-80d2-a8becb9a7e2f" status: 200 len: 1318 microversion: 2.1 time: 0.827254 Nov 16 16:06:40.431309 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 255/478] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:39 2021] GET /compute/v2.1/servers/be30cc01-fa20-42f1-80d2-a8becb9a7e2f => generated 1318 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:40.436383 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b7eafd2f-8e4a-4e47-9f80-5150201799ad tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:40.437299 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b7eafd2f-8e4a-4e47-9f80-5150201799ad tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:40.443912 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b7eafd2f-8e4a-4e47-9f80-5150201799ad tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:40.444680 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b7eafd2f-8e4a-4e47-9f80-5150201799ad tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:40.445704 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b7eafd2f-8e4a-4e47-9f80-5150201799ad tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:40.446358 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b7eafd2f-8e4a-4e47-9f80-5150201799ad tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:40.604004 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-8769202e-d520-492d-9835-7c6c6cac04f9 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:40.620479 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-8769202e-d520-492d-9835-7c6c6cac04f9 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:40.627016 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-8769202e-d520-492d-9835-7c6c6cac04f9 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:40.631576 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-8769202e-d520-492d-9835-7c6c6cac04f9 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1664 microversion: 2.20 time: 0.567260 Nov 16 16:06:40.634611 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 224/479] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:06:40 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1664 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:06:40.653199 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-b504cbc9-10a4-4236-8b98-8f3787cfa984 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23762958-d3d4-4e9a-a9b9-484e15f2ce97"}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:06:40.654653 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-b504cbc9-10a4-4236-8b98-8f3787cfa984 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:40.662716 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b504cbc9-10a4-4236-8b98-8f3787cfa984 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:40.663806 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b504cbc9-10a4-4236-8b98-8f3787cfa984 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:40.664813 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b504cbc9-10a4-4236-8b98-8f3787cfa984 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:40.665424 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b504cbc9-10a4-4236-8b98-8f3787cfa984 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:40.944476 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b7eafd2f-8e4a-4e47-9f80-5150201799ad tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:40.959519 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b7eafd2f-8e4a-4e47-9f80-5150201799ad tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1568 microversion: 2.1 time: 0.525624 Nov 16 16:06:40.970456 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 256/480] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:40 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1568 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:41.127327 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-b504cbc9-10a4-4236-8b98-8f3787cfa984 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.477767 Nov 16 16:06:41.129146 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 225/481] 10.222.0.46 () {62 vars in 1363 bytes} [Tue Nov 16 16:06:40 2021] POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/os-volume_attachments => generated 188 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 16:06:41.295771 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-2a5a0b55-6536-47a2-b8c4-29c5a32c72e7 req-29420c15-70d1-4cc7-b0aa-3dda46f759ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6447972e-6291-4e68-8271-c93523206230", "name": "network-vif-unplugged", "status": "completed", "tag": "68ede3d7-0ef4-42a4-b3de-ef6046161db6"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:06:41.298995 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:06:41.298995 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Nov 16 16:06:41.320160 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-375ecd66-6b95-494b-9bcd-c83ecb351698 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:06:41.320991 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-375ecd66-6b95-494b-9bcd-c83ecb351698 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:41.353938 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-2a5a0b55-6536-47a2-b8c4-29c5a32c72e7 req-29420c15-70d1-4cc7-b0aa-3dda46f759ce service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:41.354395 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-2a5a0b55-6536-47a2-b8c4-29c5a32c72e7 req-29420c15-70d1-4cc7-b0aa-3dda46f759ce service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:41.359733 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-375ecd66-6b95-494b-9bcd-c83ecb351698 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:41.375154 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-375ecd66-6b95-494b-9bcd-c83ecb351698 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:41.384646 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.compute.server_external_events [req-2a5a0b55-6536-47a2-b8c4-29c5a32c72e7 req-29420c15-70d1-4cc7-b0aa-3dda46f759ce service nova] Unable to find a host for instance 6447972e-6291-4e68-8271-c93523206230. Dropping event network-vif-unplugged {{(pid=116084) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 16 16:06:41.386712 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-2a5a0b55-6536-47a2-b8c4-29c5a32c72e7 req-29420c15-70d1-4cc7-b0aa-3dda46f759ce service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.095011 Nov 16 16:06:41.386843 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-375ecd66-6b95-494b-9bcd-c83ecb351698 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:41.388049 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-375ecd66-6b95-494b-9bcd-c83ecb351698 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:41.396140 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 257/482] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:06:41 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 105 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 16 16:06:41.439129 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-da4c8595-5586-400f-84a3-8a19cc993f35 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:41.440583 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-da4c8595-5586-400f-84a3-8a19cc993f35 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] [instance: be30cc01-fa20-42f1-80d2-a8becb9a7e2f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:41.451748 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-da4c8595-5586-400f-84a3-8a19cc993f35 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:41.452517 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-da4c8595-5586-400f-84a3-8a19cc993f35 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:41.453920 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-da4c8595-5586-400f-84a3-8a19cc993f35 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:41.454730 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-da4c8595-5586-400f-84a3-8a19cc993f35 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:41.576981 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-375ecd66-6b95-494b-9bcd-c83ecb351698 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action" status: 202 len: 0 microversion: 2.20 time: 0.262420 Nov 16 16:06:41.586923 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 226/483] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:06:41 2021] POST /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 16 16:06:41.592983 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-18883fac-d2ce-4a4e-a0a1-d7491715cea6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:41.595373 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-18883fac-d2ce-4a4e-a0a1-d7491715cea6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:41.606432 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-18883fac-d2ce-4a4e-a0a1-d7491715cea6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:41.607327 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-18883fac-d2ce-4a4e-a0a1-d7491715cea6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:41.609308 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-18883fac-d2ce-4a4e-a0a1-d7491715cea6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:41.609956 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-18883fac-d2ce-4a4e-a0a1-d7491715cea6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:42.183980 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-da4c8595-5586-400f-84a3-8a19cc993f35 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fcb8d8c3d490e915fe9583f70cb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bf6ebc44c444e911ba343e1c14785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:42.193367 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-da4c8595-5586-400f-84a3-8a19cc993f35 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] 10.222.0.46 "GET /compute/v2.1/servers/be30cc01-fa20-42f1-80d2-a8becb9a7e2f" status: 200 len: 1318 microversion: 2.1 time: 0.758545 Nov 16 16:06:42.203852 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 258/484] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:41 2021] GET /compute/v2.1/servers/be30cc01-fa20-42f1-80d2-a8becb9a7e2f => generated 1318 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:42.213414 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-be90b1a1-a575-4f44-a8b5-bee885ab2bfe req-308131b8-98c1-49aa-ad1b-5e9a407126d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be30cc01-fa20-42f1-80d2-a8becb9a7e2f", "tag": "91aaaca5-262f-4d80-a2a1-1efde793c011"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:06:42.215404 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:06:42.215404 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Nov 16 16:06:42.215906 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-18883fac-d2ce-4a4e-a0a1-d7491715cea6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:42.228757 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-be90b1a1-a575-4f44-a8b5-bee885ab2bfe req-308131b8-98c1-49aa-ad1b-5e9a407126d4 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:42.229398 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-be90b1a1-a575-4f44-a8b5-bee885ab2bfe req-308131b8-98c1-49aa-ad1b-5e9a407126d4 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:42.232083 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-18883fac-d2ce-4a4e-a0a1-d7491715cea6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:42.236312 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-18883fac-d2ce-4a4e-a0a1-d7491715cea6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:42.255835 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-18883fac-d2ce-4a4e-a0a1-d7491715cea6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1750 microversion: 2.20 time: 0.651387 Nov 16 16:06:42.263491 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 227/485] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:06:41 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1750 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:06:42.275592 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-6f5d3414-fe04-413c-b015-01e07c36a48c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:42.277003 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-be90b1a1-a575-4f44-a8b5-bee885ab2bfe req-308131b8-98c1-49aa-ad1b-5e9a407126d4 service nova] Creating event network-changed:91aaaca5-262f-4d80-a2a1-1efde793c011 for instance be30cc01-fa20-42f1-80d2-a8becb9a7e2f on hv-cinder-81809 Nov 16 16:06:42.278052 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-6f5d3414-fe04-413c-b015-01e07c36a48c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:42.293291 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-be90b1a1-a575-4f44-a8b5-bee885ab2bfe req-308131b8-98c1-49aa-ad1b-5e9a407126d4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087517 Nov 16 16:06:42.297418 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 259/486] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:06:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:06:42.297685 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6f5d3414-fe04-413c-b015-01e07c36a48c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:42.298675 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6f5d3414-fe04-413c-b015-01e07c36a48c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:42.299857 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6f5d3414-fe04-413c-b015-01e07c36a48c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:42.303268 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6f5d3414-fe04-413c-b015-01e07c36a48c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:42.884298 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-6f5d3414-fe04-413c-b015-01e07c36a48c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:42.898394 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-6f5d3414-fe04-413c-b015-01e07c36a48c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1548 microversion: 2.1 time: 0.632065 Nov 16 16:06:42.911726 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 228/487] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:42 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1548 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:42.918183 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a786db08-f277-407f-b884-779422baf755 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:42.918776 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-a786db08-f277-407f-b884-779422baf755 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:42.941862 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a786db08-f277-407f-b884-779422baf755 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:42.942401 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a786db08-f277-407f-b884-779422baf755 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:42.946196 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a786db08-f277-407f-b884-779422baf755 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:42.946780 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a786db08-f277-407f-b884-779422baf755 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:43.201321 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-a786db08-f277-407f-b884-779422baf755 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] HTTP exception thrown: Cannot 'detach_volume' instance 69df60e2-42c9-4caa-abdc-a7ecb61d8d73 while it is in vm_state rescued Nov 16 16:06:43.206170 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a786db08-f277-407f-b884-779422baf755 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Returning 409 to user: Cannot 'detach_volume' instance 69df60e2-42c9-4caa-abdc-a7ecb61d8d73 while it is in vm_state rescued {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:06:43.210780 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-0036a438-c595-4532-85b8-290ef73904ab tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:43.211489 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-0036a438-c595-4532-85b8-290ef73904ab tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] [instance: be30cc01-fa20-42f1-80d2-a8becb9a7e2f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:43.212251 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-a786db08-f277-407f-b884-779422baf755 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "DELETE /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73/os-volume_attachments/30eee39f-3c0b-4550-9514-218633e38054" status: 409 len: 152 microversion: 2.1 time: 0.298123 Nov 16 16:06:43.218165 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0036a438-c595-4532-85b8-290ef73904ab tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:43.218844 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0036a438-c595-4532-85b8-290ef73904ab tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:43.220283 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 260/488] 10.222.0.46 () {58 vars in 1415 bytes} [Tue Nov 16 16:06:42 2021] DELETE /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73/os-volume_attachments/30eee39f-3c0b-4550-9514-218633e38054 => generated 152 bytes in 308 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 16 16:06:43.227940 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0036a438-c595-4532-85b8-290ef73904ab tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:43.230511 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ef6dd591-39ea-4258-8955-7ba9fcbff75c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:06:43.231238 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ef6dd591-39ea-4258-8955-7ba9fcbff75c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:43.231893 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0036a438-c595-4532-85b8-290ef73904ab tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:43.257210 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ef6dd591-39ea-4258-8955-7ba9fcbff75c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:43.258359 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ef6dd591-39ea-4258-8955-7ba9fcbff75c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:43.260531 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ef6dd591-39ea-4258-8955-7ba9fcbff75c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:43.262688 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ef6dd591-39ea-4258-8955-7ba9fcbff75c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:43.484166 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ef6dd591-39ea-4258-8955-7ba9fcbff75c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "POST /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73/action" status: 202 len: 0 microversion: 2.1 time: 0.257534 Nov 16 16:06:43.490241 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 261/489] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:06:43 2021] POST /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 16 16:06:43.526189 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-5a142e75-b850-49cf-968e-9480b67163c5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:43.531566 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-5a142e75-b850-49cf-968e-9480b67163c5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:43.556497 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5a142e75-b850-49cf-968e-9480b67163c5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:43.557370 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5a142e75-b850-49cf-968e-9480b67163c5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:43.558467 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5a142e75-b850-49cf-968e-9480b67163c5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:43.559157 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5a142e75-b850-49cf-968e-9480b67163c5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:44.168910 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-0036a438-c595-4532-85b8-290ef73904ab tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fcb8d8c3d490e915fe9583f70cb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bf6ebc44c444e911ba343e1c14785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:44.177687 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-0036a438-c595-4532-85b8-290ef73904ab tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] 10.222.0.46 "GET /compute/v2.1/servers/be30cc01-fa20-42f1-80d2-a8becb9a7e2f" status: 200 len: 1318 microversion: 2.1 time: 0.970753 Nov 16 16:06:44.180187 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 229/490] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:43 2021] GET /compute/v2.1/servers/be30cc01-fa20-42f1-80d2-a8becb9a7e2f => generated 1318 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:06:44.189823 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-fbb6c70c-ee04-4e20-a240-08348f8cd78e tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:44.191963 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-fbb6c70c-ee04-4e20-a240-08348f8cd78e tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:44.193732 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-5a142e75-b850-49cf-968e-9480b67163c5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:44.221666 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-5a142e75-b850-49cf-968e-9480b67163c5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:44.228699 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-5a142e75-b850-49cf-968e-9480b67163c5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:44.230019 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-5a142e75-b850-49cf-968e-9480b67163c5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1752 microversion: 2.20 time: 0.713780 Nov 16 16:06:44.230658 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 262/491] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:06:43 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1752 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:06:44.244082 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fbb6c70c-ee04-4e20-a240-08348f8cd78e tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:44.244617 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fbb6c70c-ee04-4e20-a240-08348f8cd78e tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:44.249839 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fbb6c70c-ee04-4e20-a240-08348f8cd78e tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:44.250307 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fbb6c70c-ee04-4e20-a240-08348f8cd78e tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:44.651605 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-fbb6c70c-ee04-4e20-a240-08348f8cd78e tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:44.661835 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-fbb6c70c-ee04-4e20-a240-08348f8cd78e tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1556 microversion: 2.1 time: 0.478448 Nov 16 16:06:44.663245 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 230/492] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:44 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1556 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:45.199063 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7ca59306-b654-41f6-8990-d5e02afd6d24 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:45.199774 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-7ca59306-b654-41f6-8990-d5e02afd6d24 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] [instance: be30cc01-fa20-42f1-80d2-a8becb9a7e2f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:45.213232 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7ca59306-b654-41f6-8990-d5e02afd6d24 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:45.213956 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7ca59306-b654-41f6-8990-d5e02afd6d24 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:45.215499 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7ca59306-b654-41f6-8990-d5e02afd6d24 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:45.217028 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7ca59306-b654-41f6-8990-d5e02afd6d24 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:45.250570 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-b8f11804-7451-464e-9a4c-9d405d6ddee4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:45.252090 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-b8f11804-7451-464e-9a4c-9d405d6ddee4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:45.262993 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b8f11804-7451-464e-9a4c-9d405d6ddee4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:45.265534 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b8f11804-7451-464e-9a4c-9d405d6ddee4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:45.266719 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b8f11804-7451-464e-9a4c-9d405d6ddee4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:45.267981 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b8f11804-7451-464e-9a4c-9d405d6ddee4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:45.652850 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7ca59306-b654-41f6-8990-d5e02afd6d24 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fcb8d8c3d490e915fe9583f70cb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bf6ebc44c444e911ba343e1c14785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:45.669230 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-7ca59306-b654-41f6-8990-d5e02afd6d24 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] 10.222.0.46 "GET /compute/v2.1/servers/be30cc01-fa20-42f1-80d2-a8becb9a7e2f" status: 200 len: 1318 microversion: 2.1 time: 0.474215 Nov 16 16:06:45.674852 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-b8f11804-7451-464e-9a4c-9d405d6ddee4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:45.693236 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 263/493] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:45 2021] GET /compute/v2.1/servers/be30cc01-fa20-42f1-80d2-a8becb9a7e2f => generated 1318 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:45.701195 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-b8f11804-7451-464e-9a4c-9d405d6ddee4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:45.703127 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-b8f11804-7451-464e-9a4c-9d405d6ddee4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:45.703917 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a22da89a-7f34-4221-afb3-abd16d0dcac0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:45.705394 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-a22da89a-7f34-4221-afb3-abd16d0dcac0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:45.706329 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-b8f11804-7451-464e-9a4c-9d405d6ddee4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1808 microversion: 2.20 time: 0.459465 Nov 16 16:06:45.720590 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 231/494] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:06:45 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1808 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:06:45.731530 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a22da89a-7f34-4221-afb3-abd16d0dcac0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:45.732972 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a22da89a-7f34-4221-afb3-abd16d0dcac0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:45.734344 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a22da89a-7f34-4221-afb3-abd16d0dcac0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:45.735327 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a22da89a-7f34-4221-afb3-abd16d0dcac0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:46.009702 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-a22da89a-7f34-4221-afb3-abd16d0dcac0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:46.019962 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-a22da89a-7f34-4221-afb3-abd16d0dcac0 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1556 microversion: 2.1 time: 0.324555 Nov 16 16:06:46.020635 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 264/495] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:45 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1556 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:46.696917 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-c42506a3-6fb7-42fe-87fb-0dca5a1da9f9 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:46.697551 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-c42506a3-6fb7-42fe-87fb-0dca5a1da9f9 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] [instance: be30cc01-fa20-42f1-80d2-a8becb9a7e2f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:46.709870 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c42506a3-6fb7-42fe-87fb-0dca5a1da9f9 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:46.710315 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c42506a3-6fb7-42fe-87fb-0dca5a1da9f9 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:46.711095 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c42506a3-6fb7-42fe-87fb-0dca5a1da9f9 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:46.711751 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c42506a3-6fb7-42fe-87fb-0dca5a1da9f9 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:46.730585 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1d03fda8-f289-433f-b6c2-a9a7956bed60 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:46.731196 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1d03fda8-f289-433f-b6c2-a9a7956bed60 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:46.740009 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1d03fda8-f289-433f-b6c2-a9a7956bed60 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:46.740692 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1d03fda8-f289-433f-b6c2-a9a7956bed60 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:46.741636 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1d03fda8-f289-433f-b6c2-a9a7956bed60 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:46.742216 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1d03fda8-f289-433f-b6c2-a9a7956bed60 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:47.166866 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-c42506a3-6fb7-42fe-87fb-0dca5a1da9f9 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fcb8d8c3d490e915fe9583f70cb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bf6ebc44c444e911ba343e1c14785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:47.176377 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-c42506a3-6fb7-42fe-87fb-0dca5a1da9f9 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] 10.222.0.46 "GET /compute/v2.1/servers/be30cc01-fa20-42f1-80d2-a8becb9a7e2f" status: 200 len: 1318 microversion: 2.1 time: 0.483733 Nov 16 16:06:47.186514 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 232/496] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:46 2021] GET /compute/v2.1/servers/be30cc01-fa20-42f1-80d2-a8becb9a7e2f => generated 1318 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:47.191831 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-5632fc6e-68fd-4b6a-911f-16b14529f378 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:47.192726 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-5632fc6e-68fd-4b6a-911f-16b14529f378 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:47.199500 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5632fc6e-68fd-4b6a-911f-16b14529f378 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:47.200093 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5632fc6e-68fd-4b6a-911f-16b14529f378 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:47.201014 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5632fc6e-68fd-4b6a-911f-16b14529f378 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:47.201565 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5632fc6e-68fd-4b6a-911f-16b14529f378 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:47.244162 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1d03fda8-f289-433f-b6c2-a9a7956bed60 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:47.254821 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1d03fda8-f289-433f-b6c2-a9a7956bed60 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:47.256541 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1d03fda8-f289-433f-b6c2-a9a7956bed60 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:47.257881 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1d03fda8-f289-433f-b6c2-a9a7956bed60 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1808 microversion: 2.20 time: 0.533619 Nov 16 16:06:47.258729 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 265/497] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:06:46 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1808 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:06:47.463944 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-5632fc6e-68fd-4b6a-911f-16b14529f378 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:47.479003 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-5632fc6e-68fd-4b6a-911f-16b14529f378 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1562 microversion: 2.1 time: 0.290915 Nov 16 16:06:47.484578 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 233/498] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:47 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1562 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:47.567598 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-50ac1973-6bf2-48d3-8455-90395e9beae7 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:47.568096 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-50ac1973-6bf2-48d3-8455-90395e9beae7 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:47.575928 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-50ac1973-6bf2-48d3-8455-90395e9beae7 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:47.576627 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-50ac1973-6bf2-48d3-8455-90395e9beae7 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:47.577618 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-50ac1973-6bf2-48d3-8455-90395e9beae7 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:47.578220 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-50ac1973-6bf2-48d3-8455-90395e9beae7 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:47.719370 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.objects.instance [None req-50ac1973-6bf2-48d3-8455-90395e9beae7 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lazy-loading 'services' on Instance uuid 69df60e2-42c9-4caa-abdc-a7ecb61d8d73 {{(pid=116084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:06:47.898406 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-50ac1973-6bf2-48d3-8455-90395e9beae7 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "DELETE /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73/os-volume_attachments/30eee39f-3c0b-4550-9514-218633e38054" status: 202 len: 0 microversion: 2.1 time: 0.335646 Nov 16 16:06:47.907800 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-05ab0b1f-3b1e-43fe-846b-bc484beb41dd tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:47.909457 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-05ab0b1f-3b1e-43fe-846b-bc484beb41dd tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:47.913620 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 266/499] 10.222.0.46 () {58 vars in 1415 bytes} [Tue Nov 16 16:06:47 2021] DELETE /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73/os-volume_attachments/30eee39f-3c0b-4550-9514-218633e38054 => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:06:47.917842 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-05ab0b1f-3b1e-43fe-846b-bc484beb41dd tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:47.918300 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-05ab0b1f-3b1e-43fe-846b-bc484beb41dd tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:47.919082 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-05ab0b1f-3b1e-43fe-846b-bc484beb41dd tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:47.919550 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-05ab0b1f-3b1e-43fe-846b-bc484beb41dd tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:47.952972 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-05ab0b1f-3b1e-43fe-846b-bc484beb41dd tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049138 Nov 16 16:06:47.957979 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 234/500] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 16 16:06:47 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:06:48.197580 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d21d4208-54e7-4f90-b70c-35e13ba77606 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:48.198552 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d21d4208-54e7-4f90-b70c-35e13ba77606 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] [instance: be30cc01-fa20-42f1-80d2-a8becb9a7e2f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:48.205436 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d21d4208-54e7-4f90-b70c-35e13ba77606 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:48.205897 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d21d4208-54e7-4f90-b70c-35e13ba77606 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:48.206743 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d21d4208-54e7-4f90-b70c-35e13ba77606 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:48.207331 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d21d4208-54e7-4f90-b70c-35e13ba77606 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:48.278366 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-dc6312d2-06a0-4b18-8e58-46bf3ff187d7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:48.279261 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-dc6312d2-06a0-4b18-8e58-46bf3ff187d7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:48.291813 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-dc6312d2-06a0-4b18-8e58-46bf3ff187d7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:48.294240 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-dc6312d2-06a0-4b18-8e58-46bf3ff187d7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:48.295249 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-dc6312d2-06a0-4b18-8e58-46bf3ff187d7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:48.296815 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-dc6312d2-06a0-4b18-8e58-46bf3ff187d7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:48.451301 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d21d4208-54e7-4f90-b70c-35e13ba77606 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fcb8d8c3d490e915fe9583f70cb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bf6ebc44c444e911ba343e1c14785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:48.459775 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d21d4208-54e7-4f90-b70c-35e13ba77606 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] 10.222.0.46 "GET /compute/v2.1/servers/be30cc01-fa20-42f1-80d2-a8becb9a7e2f" status: 200 len: 1318 microversion: 2.1 time: 0.269842 Nov 16 16:06:48.475146 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 267/501] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:48 2021] GET /compute/v2.1/servers/be30cc01-fa20-42f1-80d2-a8becb9a7e2f => generated 1318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:48.577729 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-dc6312d2-06a0-4b18-8e58-46bf3ff187d7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:48.605368 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-dc6312d2-06a0-4b18-8e58-46bf3ff187d7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:48.606862 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-dc6312d2-06a0-4b18-8e58-46bf3ff187d7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:48.614487 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-dc6312d2-06a0-4b18-8e58-46bf3ff187d7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1808 microversion: 2.20 time: 0.340138 Nov 16 16:06:48.617745 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 235/502] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:06:48 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1808 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:06:48.965176 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-193223d6-0f48-49d2-af50-80466c5a8add tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:48.966059 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-193223d6-0f48-49d2-af50-80466c5a8add tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:48.973023 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-193223d6-0f48-49d2-af50-80466c5a8add tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:48.973808 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-193223d6-0f48-49d2-af50-80466c5a8add tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:48.974684 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-193223d6-0f48-49d2-af50-80466c5a8add tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:48.975158 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-193223d6-0f48-49d2-af50-80466c5a8add tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:49.009082 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-193223d6-0f48-49d2-af50-80466c5a8add tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047647 Nov 16 16:06:49.010597 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 268/503] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 16 16:06:48 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:06:49.482915 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-c9f63f5d-7645-4fad-ad5c-d10f54b85949 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:49.483559 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-c9f63f5d-7645-4fad-ad5c-d10f54b85949 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] [instance: be30cc01-fa20-42f1-80d2-a8becb9a7e2f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:49.501124 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c9f63f5d-7645-4fad-ad5c-d10f54b85949 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:49.501630 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c9f63f5d-7645-4fad-ad5c-d10f54b85949 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:49.502457 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c9f63f5d-7645-4fad-ad5c-d10f54b85949 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:49.502894 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c9f63f5d-7645-4fad-ad5c-d10f54b85949 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:49.699053 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-054f9f86-a31b-4cd1-8016-b398feded8a6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:49.700332 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-054f9f86-a31b-4cd1-8016-b398feded8a6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:49.717822 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-054f9f86-a31b-4cd1-8016-b398feded8a6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:49.718666 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-054f9f86-a31b-4cd1-8016-b398feded8a6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:49.719574 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-054f9f86-a31b-4cd1-8016-b398feded8a6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:49.722855 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-054f9f86-a31b-4cd1-8016-b398feded8a6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:49.809852 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-c9f63f5d-7645-4fad-ad5c-d10f54b85949 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fcb8d8c3d490e915fe9583f70cb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bf6ebc44c444e911ba343e1c14785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:49.831055 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-c9f63f5d-7645-4fad-ad5c-d10f54b85949 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] 10.222.0.46 "GET /compute/v2.1/servers/be30cc01-fa20-42f1-80d2-a8becb9a7e2f" status: 200 len: 1318 microversion: 2.1 time: 0.353318 Nov 16 16:06:49.832059 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 236/504] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:49 2021] GET /compute/v2.1/servers/be30cc01-fa20-42f1-80d2-a8becb9a7e2f => generated 1318 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:50.025143 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-81d995ca-96a1-4867-ac45-2dddf37aa96a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:50.026796 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-81d995ca-96a1-4867-ac45-2dddf37aa96a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:50.043224 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-81d995ca-96a1-4867-ac45-2dddf37aa96a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:50.043719 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-81d995ca-96a1-4867-ac45-2dddf37aa96a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:50.044500 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-81d995ca-96a1-4867-ac45-2dddf37aa96a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:50.044935 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-81d995ca-96a1-4867-ac45-2dddf37aa96a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:50.079207 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-054f9f86-a31b-4cd1-8016-b398feded8a6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:50.114405 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-054f9f86-a31b-4cd1-8016-b398feded8a6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:50.117096 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-054f9f86-a31b-4cd1-8016-b398feded8a6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:50.119098 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-054f9f86-a31b-4cd1-8016-b398feded8a6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1808 microversion: 2.20 time: 0.472710 Nov 16 16:06:50.120367 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 269/505] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:06:49 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1808 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:06:50.121502 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-81d995ca-96a1-4867-ac45-2dddf37aa96a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103442 Nov 16 16:06:50.126772 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 237/506] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 16 16:06:50 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:06:50.857778 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-43a29f41-66cc-44be-84a9-05a323db886e tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:50.858343 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-43a29f41-66cc-44be-84a9-05a323db886e tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] [instance: be30cc01-fa20-42f1-80d2-a8becb9a7e2f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:50.873713 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-43a29f41-66cc-44be-84a9-05a323db886e tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:50.874175 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-43a29f41-66cc-44be-84a9-05a323db886e tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:50.874981 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-43a29f41-66cc-44be-84a9-05a323db886e tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:50.875413 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-43a29f41-66cc-44be-84a9-05a323db886e tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:51.140086 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-fec2ab4b-f849-498f-815c-2172631f7a68 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:51.142441 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-fec2ab4b-f849-498f-815c-2172631f7a68 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:51.163432 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fec2ab4b-f849-498f-815c-2172631f7a68 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:51.163432 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fec2ab4b-f849-498f-815c-2172631f7a68 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:51.163755 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fec2ab4b-f849-498f-815c-2172631f7a68 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:51.164491 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fec2ab4b-f849-498f-815c-2172631f7a68 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:51.199631 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-43a29f41-66cc-44be-84a9-05a323db886e tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fcb8d8c3d490e915fe9583f70cb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bf6ebc44c444e911ba343e1c14785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:51.214213 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-43a29f41-66cc-44be-84a9-05a323db886e tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] 10.222.0.46 "GET /compute/v2.1/servers/be30cc01-fa20-42f1-80d2-a8becb9a7e2f" status: 200 len: 1318 microversion: 2.1 time: 0.368153 Nov 16 16:06:51.215065 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 270/507] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:50 2021] GET /compute/v2.1/servers/be30cc01-fa20-42f1-80d2-a8becb9a7e2f => generated 1318 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:51.221064 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-fec2ab4b-f849-498f-815c-2172631f7a68 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089859 Nov 16 16:06:51.226362 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 238/508] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 16 16:06:51 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:06:51.228930 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-dea18d36-ed48-4a03-8c52-4d4796702239 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:51.229560 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-dea18d36-ed48-4a03-8c52-4d4796702239 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:51.242833 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dea18d36-ed48-4a03-8c52-4d4796702239 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:51.243291 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dea18d36-ed48-4a03-8c52-4d4796702239 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:51.244303 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dea18d36-ed48-4a03-8c52-4d4796702239 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:51.244898 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dea18d36-ed48-4a03-8c52-4d4796702239 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:51.412943 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-dea18d36-ed48-4a03-8c52-4d4796702239 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:51.422190 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-dea18d36-ed48-4a03-8c52-4d4796702239 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:51.424015 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-dea18d36-ed48-4a03-8c52-4d4796702239 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:51.425515 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-dea18d36-ed48-4a03-8c52-4d4796702239 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1808 microversion: 2.20 time: 0.206819 Nov 16 16:06:51.437859 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 271/509] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:06:51 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1808 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:06:52.232092 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-c7075ccf-aea3-4a63-b25c-1e18c653dab5 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:52.232683 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-c7075ccf-aea3-4a63-b25c-1e18c653dab5 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] [instance: be30cc01-fa20-42f1-80d2-a8becb9a7e2f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:52.233710 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-dbc7a9fe-b761-4a5c-8337-2eeeded898fc tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:52.235435 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-dbc7a9fe-b761-4a5c-8337-2eeeded898fc tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:52.239955 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c7075ccf-aea3-4a63-b25c-1e18c653dab5 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:52.240626 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c7075ccf-aea3-4a63-b25c-1e18c653dab5 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:52.241637 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c7075ccf-aea3-4a63-b25c-1e18c653dab5 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:52.242267 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c7075ccf-aea3-4a63-b25c-1e18c653dab5 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:52.257777 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dbc7a9fe-b761-4a5c-8337-2eeeded898fc tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:52.258235 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dbc7a9fe-b761-4a5c-8337-2eeeded898fc tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:52.259046 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dbc7a9fe-b761-4a5c-8337-2eeeded898fc tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:52.259532 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dbc7a9fe-b761-4a5c-8337-2eeeded898fc tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:52.346255 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-dbc7a9fe-b761-4a5c-8337-2eeeded898fc tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116235 Nov 16 16:06:52.346847 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 272/510] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 16 16:06:52 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:06:52.448738 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f4fe3790-8369-4666-8fb0-d5507d326da5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:52.449531 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f4fe3790-8369-4666-8fb0-d5507d326da5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:52.462038 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f4fe3790-8369-4666-8fb0-d5507d326da5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:52.463248 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f4fe3790-8369-4666-8fb0-d5507d326da5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:52.464763 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f4fe3790-8369-4666-8fb0-d5507d326da5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:52.465445 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f4fe3790-8369-4666-8fb0-d5507d326da5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:52.619906 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-c7075ccf-aea3-4a63-b25c-1e18c653dab5 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fcb8d8c3d490e915fe9583f70cb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bf6ebc44c444e911ba343e1c14785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:52.651187 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-c7075ccf-aea3-4a63-b25c-1e18c653dab5 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] 10.222.0.46 "GET /compute/v2.1/servers/be30cc01-fa20-42f1-80d2-a8becb9a7e2f" status: 200 len: 1318 microversion: 2.1 time: 0.423602 Nov 16 16:06:52.657349 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 239/511] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:52 2021] GET /compute/v2.1/servers/be30cc01-fa20-42f1-80d2-a8becb9a7e2f => generated 1318 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:52.719590 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f4fe3790-8369-4666-8fb0-d5507d326da5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:52.732820 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f4fe3790-8369-4666-8fb0-d5507d326da5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:52.734524 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f4fe3790-8369-4666-8fb0-d5507d326da5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:52.736154 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f4fe3790-8369-4666-8fb0-d5507d326da5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1808 microversion: 2.20 time: 0.291106 Nov 16 16:06:52.737246 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 273/512] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:06:52 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1808 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:06:52.840896 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-9f728c53-dbeb-498f-800a-b9d17809b77f req-c69012bc-6dc1-4577-8cc7-4d05373d47fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be30cc01-fa20-42f1-80d2-a8becb9a7e2f", "name": "network-vif-plugged", "status": "completed", "tag": "91aaaca5-262f-4d80-a2a1-1efde793c011"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:06:52.842728 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:06:52.842728 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Nov 16 16:06:52.855526 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-9f728c53-dbeb-498f-800a-b9d17809b77f req-c69012bc-6dc1-4577-8cc7-4d05373d47fd service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:52.856078 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-9f728c53-dbeb-498f-800a-b9d17809b77f req-c69012bc-6dc1-4577-8cc7-4d05373d47fd service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:52.884064 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-9f728c53-dbeb-498f-800a-b9d17809b77f req-c69012bc-6dc1-4577-8cc7-4d05373d47fd service nova] Creating event network-vif-plugged:91aaaca5-262f-4d80-a2a1-1efde793c011 for instance be30cc01-fa20-42f1-80d2-a8becb9a7e2f on hv-cinder-81809 Nov 16 16:06:52.894538 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-9f728c53-dbeb-498f-800a-b9d17809b77f req-c69012bc-6dc1-4577-8cc7-4d05373d47fd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056643 Nov 16 16:06:52.903310 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 240/513] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:06:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:06:53.358169 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-681b0e5f-7e3f-4e79-a563-f55a29cb6f8c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:53.359453 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-681b0e5f-7e3f-4e79-a563-f55a29cb6f8c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:53.368287 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-681b0e5f-7e3f-4e79-a563-f55a29cb6f8c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:53.368879 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-681b0e5f-7e3f-4e79-a563-f55a29cb6f8c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:53.370157 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-681b0e5f-7e3f-4e79-a563-f55a29cb6f8c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:53.370998 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-681b0e5f-7e3f-4e79-a563-f55a29cb6f8c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:53.402871 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-681b0e5f-7e3f-4e79-a563-f55a29cb6f8c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048397 Nov 16 16:06:53.403567 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 274/514] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 16 16:06:53 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:06:53.676271 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-0dbfd241-9175-4d79-89e6-b282a16a4830 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:53.677119 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-0dbfd241-9175-4d79-89e6-b282a16a4830 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] [instance: be30cc01-fa20-42f1-80d2-a8becb9a7e2f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:53.684005 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0dbfd241-9175-4d79-89e6-b282a16a4830 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:53.684448 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0dbfd241-9175-4d79-89e6-b282a16a4830 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:53.685232 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0dbfd241-9175-4d79-89e6-b282a16a4830 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:53.685729 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0dbfd241-9175-4d79-89e6-b282a16a4830 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:53.755817 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-aa414998-5f16-4b29-9e15-d681e3888f67 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:53.756529 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-aa414998-5f16-4b29-9e15-d681e3888f67 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:53.766906 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-aa414998-5f16-4b29-9e15-d681e3888f67 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:53.767705 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-aa414998-5f16-4b29-9e15-d681e3888f67 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:53.768710 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-aa414998-5f16-4b29-9e15-d681e3888f67 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:53.769828 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-aa414998-5f16-4b29-9e15-d681e3888f67 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:53.960397 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-0dbfd241-9175-4d79-89e6-b282a16a4830 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fcb8d8c3d490e915fe9583f70cb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bf6ebc44c444e911ba343e1c14785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:53.970704 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-0dbfd241-9175-4d79-89e6-b282a16a4830 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] 10.222.0.46 "GET /compute/v2.1/servers/be30cc01-fa20-42f1-80d2-a8becb9a7e2f" status: 200 len: 1318 microversion: 2.1 time: 0.299027 Nov 16 16:06:53.972943 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 241/515] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:53 2021] GET /compute/v2.1/servers/be30cc01-fa20-42f1-80d2-a8becb9a7e2f => generated 1318 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:54.041622 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-aa414998-5f16-4b29-9e15-d681e3888f67 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:54.061791 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-aa414998-5f16-4b29-9e15-d681e3888f67 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:54.069367 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-aa414998-5f16-4b29-9e15-d681e3888f67 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:54.070582 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-aa414998-5f16-4b29-9e15-d681e3888f67 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1808 microversion: 2.20 time: 0.319834 Nov 16 16:06:54.071306 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 275/516] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:06:53 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1808 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:06:54.414204 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-3e4dbac3-e130-4a7b-aaa2-ab44e0838077 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:54.415585 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-3e4dbac3-e130-4a7b-aaa2-ab44e0838077 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:54.426859 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3e4dbac3-e130-4a7b-aaa2-ab44e0838077 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:54.427313 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3e4dbac3-e130-4a7b-aaa2-ab44e0838077 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:54.428137 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3e4dbac3-e130-4a7b-aaa2-ab44e0838077 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:54.428584 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3e4dbac3-e130-4a7b-aaa2-ab44e0838077 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:54.482566 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-3e4dbac3-e130-4a7b-aaa2-ab44e0838077 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072140 Nov 16 16:06:54.483393 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 242/517] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 16 16:06:54 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:06:54.990958 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d82333db-ac9f-44bc-9a38-e3b2e4379d55 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:54.991704 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d82333db-ac9f-44bc-9a38-e3b2e4379d55 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] [instance: be30cc01-fa20-42f1-80d2-a8becb9a7e2f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:54.998692 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d82333db-ac9f-44bc-9a38-e3b2e4379d55 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:54.999550 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d82333db-ac9f-44bc-9a38-e3b2e4379d55 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:55.001087 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d82333db-ac9f-44bc-9a38-e3b2e4379d55 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:55.001637 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d82333db-ac9f-44bc-9a38-e3b2e4379d55 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:55.090195 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-bf9066d9-73ec-45ff-a418-4b7e2c40e8b4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:55.091611 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-bf9066d9-73ec-45ff-a418-4b7e2c40e8b4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:55.100056 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bf9066d9-73ec-45ff-a418-4b7e2c40e8b4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:55.100733 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bf9066d9-73ec-45ff-a418-4b7e2c40e8b4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:55.101763 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bf9066d9-73ec-45ff-a418-4b7e2c40e8b4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:55.102554 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bf9066d9-73ec-45ff-a418-4b7e2c40e8b4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:55.165666 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d82333db-ac9f-44bc-9a38-e3b2e4379d55 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fcb8d8c3d490e915fe9583f70cb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bf6ebc44c444e911ba343e1c14785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:55.173501 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d82333db-ac9f-44bc-9a38-e3b2e4379d55 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] 10.222.0.46 "GET /compute/v2.1/servers/be30cc01-fa20-42f1-80d2-a8becb9a7e2f" status: 200 len: 1318 microversion: 2.1 time: 0.187636 Nov 16 16:06:55.188378 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 276/518] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:54 2021] GET /compute/v2.1/servers/be30cc01-fa20-42f1-80d2-a8becb9a7e2f => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:55.273468 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-bf9066d9-73ec-45ff-a418-4b7e2c40e8b4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:55.283480 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-bf9066d9-73ec-45ff-a418-4b7e2c40e8b4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:55.285666 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-bf9066d9-73ec-45ff-a418-4b7e2c40e8b4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:55.287065 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-bf9066d9-73ec-45ff-a418-4b7e2c40e8b4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1808 microversion: 2.20 time: 0.200869 Nov 16 16:06:55.287813 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 243/519] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:06:55 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1808 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:06:55.495343 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3ae44ad1-9578-4355-b227-3b9018590c0d tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:55.496386 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-3ae44ad1-9578-4355-b227-3b9018590c0d tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:55.502642 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3ae44ad1-9578-4355-b227-3b9018590c0d tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:55.503256 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3ae44ad1-9578-4355-b227-3b9018590c0d tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:55.504159 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3ae44ad1-9578-4355-b227-3b9018590c0d tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:55.504663 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3ae44ad1-9578-4355-b227-3b9018590c0d tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:55.536224 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-3ae44ad1-9578-4355-b227-3b9018590c0d tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045393 Nov 16 16:06:55.536785 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 277/520] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 16 16:06:55 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:06:56.200699 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-3a54ba33-211e-4a18-bb5a-6b2c7a2c8f3c tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:56.202880 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-3a54ba33-211e-4a18-bb5a-6b2c7a2c8f3c tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] [instance: be30cc01-fa20-42f1-80d2-a8becb9a7e2f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:56.213113 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3a54ba33-211e-4a18-bb5a-6b2c7a2c8f3c tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:56.213709 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3a54ba33-211e-4a18-bb5a-6b2c7a2c8f3c tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:56.214378 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3a54ba33-211e-4a18-bb5a-6b2c7a2c8f3c tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:56.214882 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3a54ba33-211e-4a18-bb5a-6b2c7a2c8f3c tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:56.306250 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e10d25b8-483c-4d85-98e7-474c9463d724 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:56.308353 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e10d25b8-483c-4d85-98e7-474c9463d724 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:56.321594 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e10d25b8-483c-4d85-98e7-474c9463d724 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:56.322148 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e10d25b8-483c-4d85-98e7-474c9463d724 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:56.323324 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e10d25b8-483c-4d85-98e7-474c9463d724 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:56.323943 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e10d25b8-483c-4d85-98e7-474c9463d724 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:56.371116 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-3a54ba33-211e-4a18-bb5a-6b2c7a2c8f3c tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fcb8d8c3d490e915fe9583f70cb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bf6ebc44c444e911ba343e1c14785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:56.379638 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-3a54ba33-211e-4a18-bb5a-6b2c7a2c8f3c tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] 10.222.0.46 "GET /compute/v2.1/servers/be30cc01-fa20-42f1-80d2-a8becb9a7e2f" status: 200 len: 1318 microversion: 2.1 time: 0.184705 Nov 16 16:06:56.389389 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 244/521] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:56 2021] GET /compute/v2.1/servers/be30cc01-fa20-42f1-80d2-a8becb9a7e2f => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:06:56.517665 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e10d25b8-483c-4d85-98e7-474c9463d724 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:56.528053 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e10d25b8-483c-4d85-98e7-474c9463d724 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:56.532087 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e10d25b8-483c-4d85-98e7-474c9463d724 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:56.534013 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e10d25b8-483c-4d85-98e7-474c9463d724 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1808 microversion: 2.20 time: 0.232383 Nov 16 16:06:56.534793 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 278/522] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:06:56 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1808 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:06:56.551899 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-8eddf2e9-1d1c-423a-9bd8-53d2ad2451d9 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:56.553155 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-8eddf2e9-1d1c-423a-9bd8-53d2ad2451d9 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:56.566311 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8eddf2e9-1d1c-423a-9bd8-53d2ad2451d9 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:56.570382 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8eddf2e9-1d1c-423a-9bd8-53d2ad2451d9 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:56.571493 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8eddf2e9-1d1c-423a-9bd8-53d2ad2451d9 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:56.572176 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8eddf2e9-1d1c-423a-9bd8-53d2ad2451d9 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:56.612555 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-8eddf2e9-1d1c-423a-9bd8-53d2ad2451d9 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067106 Nov 16 16:06:56.613915 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 245/523] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 16 16:06:56 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:06:57.398475 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-46a8c419-a6b2-4012-9565-9cbf2b4d5d7f tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:57.399239 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-46a8c419-a6b2-4012-9565-9cbf2b4d5d7f tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] [instance: be30cc01-fa20-42f1-80d2-a8becb9a7e2f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:57.406005 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-46a8c419-a6b2-4012-9565-9cbf2b4d5d7f tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:57.406462 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-46a8c419-a6b2-4012-9565-9cbf2b4d5d7f tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:57.407253 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-46a8c419-a6b2-4012-9565-9cbf2b4d5d7f tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:57.407725 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-46a8c419-a6b2-4012-9565-9cbf2b4d5d7f tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:57.545488 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-46a8c419-a6b2-4012-9565-9cbf2b4d5d7f tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fcb8d8c3d490e915fe9583f70cb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bf6ebc44c444e911ba343e1c14785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:57.554375 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-46a8c419-a6b2-4012-9565-9cbf2b4d5d7f tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] 10.222.0.46 "GET /compute/v2.1/servers/be30cc01-fa20-42f1-80d2-a8becb9a7e2f" status: 200 len: 1318 microversion: 2.1 time: 0.161330 Nov 16 16:06:57.554718 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-9e0a5814-7106-490c-bc6a-aae33fccfdc7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:57.563880 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-9e0a5814-7106-490c-bc6a-aae33fccfdc7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:57.564088 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 279/524] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:57 2021] GET /compute/v2.1/servers/be30cc01-fa20-42f1-80d2-a8becb9a7e2f => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:06:57.564199 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9e0a5814-7106-490c-bc6a-aae33fccfdc7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:57.564199 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9e0a5814-7106-490c-bc6a-aae33fccfdc7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:57.564199 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9e0a5814-7106-490c-bc6a-aae33fccfdc7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:57.564199 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9e0a5814-7106-490c-bc6a-aae33fccfdc7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:57.629384 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6f3d4577-b92e-4d9a-a6fc-3d04e2353154 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:57.629384 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-6f3d4577-b92e-4d9a-a6fc-3d04e2353154 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:57.634603 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6f3d4577-b92e-4d9a-a6fc-3d04e2353154 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:57.635634 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6f3d4577-b92e-4d9a-a6fc-3d04e2353154 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:57.636720 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6f3d4577-b92e-4d9a-a6fc-3d04e2353154 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:57.637343 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6f3d4577-b92e-4d9a-a6fc-3d04e2353154 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:57.673051 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-6f3d4577-b92e-4d9a-a6fc-3d04e2353154 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051625 Nov 16 16:06:57.674081 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 280/525] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 16 16:06:57 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:06:57.712532 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-9e0a5814-7106-490c-bc6a-aae33fccfdc7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:57.721106 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-9e0a5814-7106-490c-bc6a-aae33fccfdc7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:57.722654 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-9e0a5814-7106-490c-bc6a-aae33fccfdc7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:57.723864 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-9e0a5814-7106-490c-bc6a-aae33fccfdc7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1808 microversion: 2.20 time: 0.174002 Nov 16 16:06:57.724449 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 246/526] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:06:57 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:06:58.572609 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-86de0bd7-48a0-4aa7-a1d6-c6eafc21a620 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:58.573622 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-86de0bd7-48a0-4aa7-a1d6-c6eafc21a620 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] [instance: be30cc01-fa20-42f1-80d2-a8becb9a7e2f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:58.580093 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-86de0bd7-48a0-4aa7-a1d6-c6eafc21a620 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:58.580538 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-86de0bd7-48a0-4aa7-a1d6-c6eafc21a620 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:58.581346 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-86de0bd7-48a0-4aa7-a1d6-c6eafc21a620 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:58.581783 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-86de0bd7-48a0-4aa7-a1d6-c6eafc21a620 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:58.694820 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-b5eab406-9dfb-418e-b661-c4029b4ba32a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:58.696300 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-b5eab406-9dfb-418e-b661-c4029b4ba32a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:58.702694 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b5eab406-9dfb-418e-b661-c4029b4ba32a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:58.703651 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b5eab406-9dfb-418e-b661-c4029b4ba32a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:58.704812 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b5eab406-9dfb-418e-b661-c4029b4ba32a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:58.705591 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b5eab406-9dfb-418e-b661-c4029b4ba32a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:58.733628 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-86de0bd7-48a0-4aa7-a1d6-c6eafc21a620 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fcb8d8c3d490e915fe9583f70cb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bf6ebc44c444e911ba343e1c14785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:58.741390 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-86de0bd7-48a0-4aa7-a1d6-c6eafc21a620 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] 10.222.0.46 "GET /compute/v2.1/servers/be30cc01-fa20-42f1-80d2-a8becb9a7e2f" status: 200 len: 1318 microversion: 2.1 time: 0.172419 Nov 16 16:06:58.741971 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 281/527] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:58 2021] GET /compute/v2.1/servers/be30cc01-fa20-42f1-80d2-a8becb9a7e2f => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:06:58.744864 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-b5eab406-9dfb-418e-b661-c4029b4ba32a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062510 Nov 16 16:06:58.745418 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 247/528] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 16 16:06:58 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:06:58.746555 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7830f6aa-c508-43e2-a17a-b4bae9cf28f1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:58.747160 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-7830f6aa-c508-43e2-a17a-b4bae9cf28f1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:58.753004 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7830f6aa-c508-43e2-a17a-b4bae9cf28f1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:58.753992 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7830f6aa-c508-43e2-a17a-b4bae9cf28f1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:58.754955 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7830f6aa-c508-43e2-a17a-b4bae9cf28f1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:58.755392 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7830f6aa-c508-43e2-a17a-b4bae9cf28f1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:58.896033 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7830f6aa-c508-43e2-a17a-b4bae9cf28f1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:58.904912 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7830f6aa-c508-43e2-a17a-b4bae9cf28f1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:58.906399 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7830f6aa-c508-43e2-a17a-b4bae9cf28f1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:58.907775 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-7830f6aa-c508-43e2-a17a-b4bae9cf28f1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1808 microversion: 2.20 time: 0.164680 Nov 16 16:06:58.908132 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 282/529] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:06:58 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:06:59.757111 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-d74279c7-6368-44fc-9987-9c4df1888706 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:59.759272 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-25ac1aee-aac7-49fe-afa1-2873f6e9a172 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:59.759843 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-d74279c7-6368-44fc-9987-9c4df1888706 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:59.761663 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-25ac1aee-aac7-49fe-afa1-2873f6e9a172 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] [instance: be30cc01-fa20-42f1-80d2-a8becb9a7e2f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:59.768838 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d74279c7-6368-44fc-9987-9c4df1888706 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:59.769993 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d74279c7-6368-44fc-9987-9c4df1888706 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:59.770341 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-25ac1aee-aac7-49fe-afa1-2873f6e9a172 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:59.770796 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d74279c7-6368-44fc-9987-9c4df1888706 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:59.770964 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-25ac1aee-aac7-49fe-afa1-2873f6e9a172 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:59.771235 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d74279c7-6368-44fc-9987-9c4df1888706 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:59.772671 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-25ac1aee-aac7-49fe-afa1-2873f6e9a172 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:59.773315 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-25ac1aee-aac7-49fe-afa1-2873f6e9a172 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:59.806847 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-d74279c7-6368-44fc-9987-9c4df1888706 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054319 Nov 16 16:06:59.807920 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 248/530] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 16 16:06:59 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:06:59.924125 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-25ac1aee-aac7-49fe-afa1-2873f6e9a172 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fcb8d8c3d490e915fe9583f70cb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bf6ebc44c444e911ba343e1c14785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:06:59.930314 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-f1369be0-0168-416a-9777-7300624f1449 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:59.931628 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-f1369be0-0168-416a-9777-7300624f1449 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:06:59.934528 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-25ac1aee-aac7-49fe-afa1-2873f6e9a172 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] 10.222.0.46 "GET /compute/v2.1/servers/be30cc01-fa20-42f1-80d2-a8becb9a7e2f" status: 200 len: 1318 microversion: 2.1 time: 0.178925 Nov 16 16:06:59.944496 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 283/531] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:06:59 2021] GET /compute/v2.1/servers/be30cc01-fa20-42f1-80d2-a8becb9a7e2f => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:06:59.945014 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f1369be0-0168-416a-9777-7300624f1449 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:59.945014 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f1369be0-0168-416a-9777-7300624f1449 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:59.945014 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f1369be0-0168-416a-9777-7300624f1449 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:59.945014 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f1369be0-0168-416a-9777-7300624f1449 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:00.531396 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-f1369be0-0168-416a-9777-7300624f1449 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:00.541858 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-f1369be0-0168-416a-9777-7300624f1449 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:00.543450 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-f1369be0-0168-416a-9777-7300624f1449 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:00.544719 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-f1369be0-0168-416a-9777-7300624f1449 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1808 microversion: 2.20 time: 0.620915 Nov 16 16:07:00.545342 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 249/532] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:06:59 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1808 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:07:00.818715 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-fdd6fb39-937d-486d-a74e-a9ea2cb1478e tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:00.819745 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-fdd6fb39-937d-486d-a74e-a9ea2cb1478e tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:00.825948 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fdd6fb39-937d-486d-a74e-a9ea2cb1478e tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:00.826396 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fdd6fb39-937d-486d-a74e-a9ea2cb1478e tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:00.827182 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fdd6fb39-937d-486d-a74e-a9ea2cb1478e tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:00.827646 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fdd6fb39-937d-486d-a74e-a9ea2cb1478e tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:00.885925 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-fdd6fb39-937d-486d-a74e-a9ea2cb1478e tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071596 Nov 16 16:07:00.886497 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 284/533] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 16 16:07:00 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:07:00.951986 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-db31174d-c1de-42c2-bab1-5760e3e0b07d tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:00.952641 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-db31174d-c1de-42c2-bab1-5760e3e0b07d tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] [instance: be30cc01-fa20-42f1-80d2-a8becb9a7e2f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:00.959512 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-db31174d-c1de-42c2-bab1-5760e3e0b07d tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:00.959965 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-db31174d-c1de-42c2-bab1-5760e3e0b07d tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:00.960755 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-db31174d-c1de-42c2-bab1-5760e3e0b07d tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:00.961221 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-db31174d-c1de-42c2-bab1-5760e3e0b07d tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:01.235025 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-db31174d-c1de-42c2-bab1-5760e3e0b07d tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fcb8d8c3d490e915fe9583f70cb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bf6ebc44c444e911ba343e1c14785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:01.242612 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-db31174d-c1de-42c2-bab1-5760e3e0b07d tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] 10.222.0.46 "GET /compute/v2.1/servers/be30cc01-fa20-42f1-80d2-a8becb9a7e2f" status: 200 len: 1318 microversion: 2.1 time: 0.294317 Nov 16 16:07:01.243537 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 250/534] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:00 2021] GET /compute/v2.1/servers/be30cc01-fa20-42f1-80d2-a8becb9a7e2f => generated 1318 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:01.565353 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-9618a03c-0f61-4d66-b1a1-6ccef3bd4c66 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:01.566079 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-9618a03c-0f61-4d66-b1a1-6ccef3bd4c66 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:01.572473 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9618a03c-0f61-4d66-b1a1-6ccef3bd4c66 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:01.572979 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9618a03c-0f61-4d66-b1a1-6ccef3bd4c66 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:01.573765 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9618a03c-0f61-4d66-b1a1-6ccef3bd4c66 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:01.574236 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9618a03c-0f61-4d66-b1a1-6ccef3bd4c66 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:01.736787 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-9618a03c-0f61-4d66-b1a1-6ccef3bd4c66 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:01.747056 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-9618a03c-0f61-4d66-b1a1-6ccef3bd4c66 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:01.748819 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-9618a03c-0f61-4d66-b1a1-6ccef3bd4c66 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:01.749998 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-9618a03c-0f61-4d66-b1a1-6ccef3bd4c66 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1808 microversion: 2.20 time: 0.190161 Nov 16 16:07:01.750554 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 285/535] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:07:01 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:07:01.897369 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-db1bb4bc-2458-44ae-9ac7-d3d1bfa69cab tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:01.898578 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-db1bb4bc-2458-44ae-9ac7-d3d1bfa69cab tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:01.905663 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-db1bb4bc-2458-44ae-9ac7-d3d1bfa69cab tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:01.906295 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-db1bb4bc-2458-44ae-9ac7-d3d1bfa69cab tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:01.907130 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-db1bb4bc-2458-44ae-9ac7-d3d1bfa69cab tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:01.907533 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-db1bb4bc-2458-44ae-9ac7-d3d1bfa69cab tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:01.941112 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-db1bb4bc-2458-44ae-9ac7-d3d1bfa69cab tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047463 Nov 16 16:07:01.942442 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 251/536] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 16 16:07:01 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 16:07:02.264928 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-68ac7240-5679-4bb4-a261-929d885477e9 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:02.267001 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-68ac7240-5679-4bb4-a261-929d885477e9 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] [instance: be30cc01-fa20-42f1-80d2-a8becb9a7e2f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:02.275152 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-68ac7240-5679-4bb4-a261-929d885477e9 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:02.275695 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-68ac7240-5679-4bb4-a261-929d885477e9 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:02.276490 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-68ac7240-5679-4bb4-a261-929d885477e9 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:02.277649 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-68ac7240-5679-4bb4-a261-929d885477e9 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:02.424304 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-68ac7240-5679-4bb4-a261-929d885477e9 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fcb8d8c3d490e915fe9583f70cb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bf6ebc44c444e911ba343e1c14785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:02.432417 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-68ac7240-5679-4bb4-a261-929d885477e9 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] 10.222.0.46 "GET /compute/v2.1/servers/be30cc01-fa20-42f1-80d2-a8becb9a7e2f" status: 200 len: 1507 microversion: 2.1 time: 0.174252 Nov 16 16:07:02.432924 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 286/537] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:02 2021] GET /compute/v2.1/servers/be30cc01-fa20-42f1-80d2-a8becb9a7e2f => generated 1507 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:02.770172 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-13114b12-b6e8-48b4-80d3-298432128fa1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:02.771702 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-13114b12-b6e8-48b4-80d3-298432128fa1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:02.779664 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-13114b12-b6e8-48b4-80d3-298432128fa1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:02.780146 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-13114b12-b6e8-48b4-80d3-298432128fa1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:02.781636 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-13114b12-b6e8-48b4-80d3-298432128fa1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:02.782806 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-13114b12-b6e8-48b4-80d3-298432128fa1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:02.994450 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-13114b12-b6e8-48b4-80d3-298432128fa1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:03.004045 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-13114b12-b6e8-48b4-80d3-298432128fa1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:03.006605 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-13114b12-b6e8-48b4-80d3-298432128fa1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:03.007836 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-13114b12-b6e8-48b4-80d3-298432128fa1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1808 microversion: 2.20 time: 0.242198 Nov 16 16:07:03.008663 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 252/538] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:07:02 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1808 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:07:04.030528 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6ca76b33-74ae-4927-86d6-5f82386214b6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:04.031412 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-6ca76b33-74ae-4927-86d6-5f82386214b6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:04.040091 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6ca76b33-74ae-4927-86d6-5f82386214b6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:04.040777 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6ca76b33-74ae-4927-86d6-5f82386214b6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:04.041732 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6ca76b33-74ae-4927-86d6-5f82386214b6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:04.042470 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6ca76b33-74ae-4927-86d6-5f82386214b6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:04.270879 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-6ca76b33-74ae-4927-86d6-5f82386214b6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:04.280530 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-6ca76b33-74ae-4927-86d6-5f82386214b6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:04.283801 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-6ca76b33-74ae-4927-86d6-5f82386214b6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:04.285354 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-6ca76b33-74ae-4927-86d6-5f82386214b6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1808 microversion: 2.20 time: 0.260568 Nov 16 16:07:04.296367 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 287/539] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:07:04 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1808 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:07:04.312200 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-c6a68144-3cc4-44fa-a1de-a0adbfe3d65a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:04.313345 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-c6a68144-3cc4-44fa-a1de-a0adbfe3d65a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:04.320919 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c6a68144-3cc4-44fa-a1de-a0adbfe3d65a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:04.321364 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c6a68144-3cc4-44fa-a1de-a0adbfe3d65a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:04.322149 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c6a68144-3cc4-44fa-a1de-a0adbfe3d65a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:04.322583 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c6a68144-3cc4-44fa-a1de-a0adbfe3d65a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:04.349996 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-c6a68144-3cc4-44fa-a1de-a0adbfe3d65a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Going to try to terminate instance {{(pid=116085) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 16:07:04.452143 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-c6a68144-3cc4-44fa-a1de-a0adbfe3d65a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "DELETE /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248" status: 204 len: 0 microversion: 2.1 time: 0.140351 Nov 16 16:07:04.454323 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 253/540] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 16 16:07:04 2021] DELETE /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 16:07:04.467937 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-8218490d-9d61-48fb-95aa-315af0baa43f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:04.468568 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-8218490d-9d61-48fb-95aa-315af0baa43f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:04.477875 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8218490d-9d61-48fb-95aa-315af0baa43f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:04.478328 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8218490d-9d61-48fb-95aa-315af0baa43f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:04.479127 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8218490d-9d61-48fb-95aa-315af0baa43f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:04.479647 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8218490d-9d61-48fb-95aa-315af0baa43f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:04.654298 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-8218490d-9d61-48fb-95aa-315af0baa43f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:04.667070 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-8218490d-9d61-48fb-95aa-315af0baa43f tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248" status: 200 len: 1508 microversion: 2.1 time: 0.206192 Nov 16 16:07:04.668239 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 288/541] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:04 2021] GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248 => generated 1508 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:05.307152 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-b63d4166-8a2c-4b31-b098-0e5285899164 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:05.308315 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-b63d4166-8a2c-4b31-b098-0e5285899164 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:05.316219 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b63d4166-8a2c-4b31-b098-0e5285899164 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:05.317349 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b63d4166-8a2c-4b31-b098-0e5285899164 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:05.322499 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b63d4166-8a2c-4b31-b098-0e5285899164 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:05.323033 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b63d4166-8a2c-4b31-b098-0e5285899164 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:05.608893 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-b63d4166-8a2c-4b31-b098-0e5285899164 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:05.625893 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-b63d4166-8a2c-4b31-b098-0e5285899164 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:05.633011 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-b63d4166-8a2c-4b31-b098-0e5285899164 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:05.634337 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-b63d4166-8a2c-4b31-b098-0e5285899164 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1808 microversion: 2.20 time: 0.332799 Nov 16 16:07:05.635006 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 254/542] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:07:05 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1808 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:07:05.685602 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3b235b21-9a02-4b2c-8431-b0573fed3bc5 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:05.686825 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-3b235b21-9a02-4b2c-8431-b0573fed3bc5 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:05.694742 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3b235b21-9a02-4b2c-8431-b0573fed3bc5 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:05.695193 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3b235b21-9a02-4b2c-8431-b0573fed3bc5 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:05.696178 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3b235b21-9a02-4b2c-8431-b0573fed3bc5 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:05.696452 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3b235b21-9a02-4b2c-8431-b0573fed3bc5 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:06.012323 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-3b235b21-9a02-4b2c-8431-b0573fed3bc5 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:06.020512 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-3b235b21-9a02-4b2c-8431-b0573fed3bc5 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248" status: 200 len: 1508 microversion: 2.1 time: 0.338499 Nov 16 16:07:06.028627 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 289/543] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:05 2021] GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248 => generated 1508 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:06.653960 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-222de8b9-5526-42a1-935b-57d7ba932ceb tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:06.655134 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-222de8b9-5526-42a1-935b-57d7ba932ceb tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:06.662887 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-222de8b9-5526-42a1-935b-57d7ba932ceb tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:06.663328 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-222de8b9-5526-42a1-935b-57d7ba932ceb tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:06.664154 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-222de8b9-5526-42a1-935b-57d7ba932ceb tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:06.664773 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-222de8b9-5526-42a1-935b-57d7ba932ceb tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:06.939429 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-222de8b9-5526-42a1-935b-57d7ba932ceb tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:06.954421 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-222de8b9-5526-42a1-935b-57d7ba932ceb tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:06.956767 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-222de8b9-5526-42a1-935b-57d7ba932ceb tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:06.958339 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-222de8b9-5526-42a1-935b-57d7ba932ceb tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1808 microversion: 2.20 time: 0.308871 Nov 16 16:07:06.959009 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 255/544] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:07:06 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1808 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:07:07.038603 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d224e7fd-b4a1-4c95-bd01-5eeee9b6f0b5 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:07.040050 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d224e7fd-b4a1-4c95-bd01-5eeee9b6f0b5 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:07.051061 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d224e7fd-b4a1-4c95-bd01-5eeee9b6f0b5 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:07.052147 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d224e7fd-b4a1-4c95-bd01-5eeee9b6f0b5 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:07.053199 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d224e7fd-b4a1-4c95-bd01-5eeee9b6f0b5 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:07.054371 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d224e7fd-b4a1-4c95-bd01-5eeee9b6f0b5 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:07.306282 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d224e7fd-b4a1-4c95-bd01-5eeee9b6f0b5 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:07.314114 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d224e7fd-b4a1-4c95-bd01-5eeee9b6f0b5 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248" status: 200 len: 1508 microversion: 2.1 time: 0.279968 Nov 16 16:07:07.314783 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 290/545] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:07 2021] GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248 => generated 1508 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:07.980709 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-feb4e6de-59b9-4244-8f39-48b76da4a7d7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:07.981327 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-feb4e6de-59b9-4244-8f39-48b76da4a7d7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:07.989185 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-feb4e6de-59b9-4244-8f39-48b76da4a7d7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:07.989641 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-feb4e6de-59b9-4244-8f39-48b76da4a7d7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:07.990438 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-feb4e6de-59b9-4244-8f39-48b76da4a7d7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:07.990876 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-feb4e6de-59b9-4244-8f39-48b76da4a7d7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:08.110178 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-1db4655d-ef99-4bf2-8382-05bf9f98337a req-8789f731-5b36-4033-985c-196d41bf4b08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78398054-0c37-4dfb-8926-a199cdf30248", "name": "network-vif-deleted", "tag": "79ddbfbc-87d6-4cbb-8ab7-1840fe13a61a"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:07:08.111764 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:07:08.111764 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Nov 16 16:07:08.121001 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-1db4655d-ef99-4bf2-8382-05bf9f98337a req-8789f731-5b36-4033-985c-196d41bf4b08 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:08.121444 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-1db4655d-ef99-4bf2-8382-05bf9f98337a req-8789f731-5b36-4033-985c-196d41bf4b08 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:08.136363 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-1db4655d-ef99-4bf2-8382-05bf9f98337a req-8789f731-5b36-4033-985c-196d41bf4b08 service nova] Creating event network-vif-deleted:79ddbfbc-87d6-4cbb-8ab7-1840fe13a61a for instance 78398054-0c37-4dfb-8926-a199cdf30248 on hv-cinder-81809 Nov 16 16:07:08.145910 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-1db4655d-ef99-4bf2-8382-05bf9f98337a req-8789f731-5b36-4033-985c-196d41bf4b08 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038425 Nov 16 16:07:08.146903 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 291/546] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:07:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:07:08.266023 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-feb4e6de-59b9-4244-8f39-48b76da4a7d7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:08.279640 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-feb4e6de-59b9-4244-8f39-48b76da4a7d7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:08.282132 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-feb4e6de-59b9-4244-8f39-48b76da4a7d7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:08.283583 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-feb4e6de-59b9-4244-8f39-48b76da4a7d7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1808 microversion: 2.20 time: 0.309658 Nov 16 16:07:08.284259 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 256/547] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:07:07 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1808 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:07:08.334457 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-18547c2a-321f-471d-bb16-6303b1bb1183 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:08.335271 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-18547c2a-321f-471d-bb16-6303b1bb1183 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:08.343362 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-18547c2a-321f-471d-bb16-6303b1bb1183 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:08.344293 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-18547c2a-321f-471d-bb16-6303b1bb1183 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:08.345313 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-18547c2a-321f-471d-bb16-6303b1bb1183 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:08.345917 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-18547c2a-321f-471d-bb16-6303b1bb1183 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:08.398702 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-18547c2a-321f-471d-bb16-6303b1bb1183 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:08.399726 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-18547c2a-321f-471d-bb16-6303b1bb1183 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:08.401362 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.objects.instance [None req-18547c2a-321f-471d-bb16-6303b1bb1183 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lazy-loading 'fault' on Instance uuid 78398054-0c37-4dfb-8926-a199cdf30248 {{(pid=116084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:07:08.490726 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-18547c2a-321f-471d-bb16-6303b1bb1183 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:08.505458 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-18547c2a-321f-471d-bb16-6303b1bb1183 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248" status: 200 len: 1312 microversion: 2.1 time: 0.176244 Nov 16 16:07:08.506582 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 292/548] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:08 2021] GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248 => generated 1312 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:09.302770 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-eacb898e-2592-4379-a93d-5779e497c539 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:09.304111 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-eacb898e-2592-4379-a93d-5779e497c539 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:09.311202 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-eacb898e-2592-4379-a93d-5779e497c539 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:09.311674 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-eacb898e-2592-4379-a93d-5779e497c539 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:09.313006 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-eacb898e-2592-4379-a93d-5779e497c539 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:09.313450 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-eacb898e-2592-4379-a93d-5779e497c539 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:09.462735 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-eacb898e-2592-4379-a93d-5779e497c539 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:09.472805 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-eacb898e-2592-4379-a93d-5779e497c539 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:09.474749 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-eacb898e-2592-4379-a93d-5779e497c539 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:09.476149 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-eacb898e-2592-4379-a93d-5779e497c539 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1808 microversion: 2.20 time: 0.177889 Nov 16 16:07:09.488408 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 257/549] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:07:09 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:07:09.523173 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ab0d58c2-da2b-40ad-b3f1-919c3c0e049a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:09.534535 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ab0d58c2-da2b-40ad-b3f1-919c3c0e049a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 78398054-0c37-4dfb-8926-a199cdf30248] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:09.543247 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ab0d58c2-da2b-40ad-b3f1-919c3c0e049a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:09.543822 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ab0d58c2-da2b-40ad-b3f1-919c3c0e049a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:09.544620 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ab0d58c2-da2b-40ad-b3f1-919c3c0e049a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:09.545197 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ab0d58c2-da2b-40ad-b3f1-919c3c0e049a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:09.563504 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-ab0d58c2-da2b-40ad-b3f1-919c3c0e049a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] HTTP exception thrown: Instance 78398054-0c37-4dfb-8926-a199cdf30248 could not be found. Nov 16 16:07:09.564125 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ab0d58c2-da2b-40ad-b3f1-919c3c0e049a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Returning 404 to user: Instance 78398054-0c37-4dfb-8926-a199cdf30248 could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:07:09.564955 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ab0d58c2-da2b-40ad-b3f1-919c3c0e049a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248" status: 404 len: 111 microversion: 2.1 time: 0.046812 Nov 16 16:07:09.566935 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 293/550] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:09 2021] GET /compute/v2.1/servers/78398054-0c37-4dfb-8926-a199cdf30248 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:07:09.574610 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-dc87c889-2bcb-45d0-aa1d-3f4c3e03390b tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:09.575325 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-dc87c889-2bcb-45d0-aa1d-3f4c3e03390b tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:09.582263 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-dc87c889-2bcb-45d0-aa1d-3f4c3e03390b tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:09.582711 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-dc87c889-2bcb-45d0-aa1d-3f4c3e03390b tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:09.583531 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-dc87c889-2bcb-45d0-aa1d-3f4c3e03390b tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:09.583966 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-dc87c889-2bcb-45d0-aa1d-3f4c3e03390b tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:09.619350 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-dc87c889-2bcb-45d0-aa1d-3f4c3e03390b tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Going to try to terminate instance {{(pid=116085) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 16:07:09.711540 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-dc87c889-2bcb-45d0-aa1d-3f4c3e03390b tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "DELETE /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 204 len: 0 microversion: 2.1 time: 0.140072 Nov 16 16:07:09.712401 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 258/551] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 16 16:07:09 2021] DELETE /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 16:07:09.722712 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-dfaac10a-b13a-451a-ac55-6a0c68c3aac9 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:09.723797 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-dfaac10a-b13a-451a-ac55-6a0c68c3aac9 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:09.733795 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dfaac10a-b13a-451a-ac55-6a0c68c3aac9 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:09.734398 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dfaac10a-b13a-451a-ac55-6a0c68c3aac9 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:09.735232 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dfaac10a-b13a-451a-ac55-6a0c68c3aac9 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:09.736517 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dfaac10a-b13a-451a-ac55-6a0c68c3aac9 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:09.889391 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-dfaac10a-b13a-451a-ac55-6a0c68c3aac9 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:09.902334 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-dfaac10a-b13a-451a-ac55-6a0c68c3aac9 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1522 microversion: 2.1 time: 0.185442 Nov 16 16:07:09.903420 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 294/552] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:09 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:10.496589 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-64fab43b-640f-4928-b167-eded146e6f65 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:10.497860 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-64fab43b-640f-4928-b167-eded146e6f65 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:10.511693 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-64fab43b-640f-4928-b167-eded146e6f65 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:10.512931 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-64fab43b-640f-4928-b167-eded146e6f65 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:10.514398 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-64fab43b-640f-4928-b167-eded146e6f65 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:10.515136 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-64fab43b-640f-4928-b167-eded146e6f65 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:10.894104 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-64fab43b-640f-4928-b167-eded146e6f65 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:10.905097 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-64fab43b-640f-4928-b167-eded146e6f65 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:10.907961 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-64fab43b-640f-4928-b167-eded146e6f65 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:10.909699 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-64fab43b-640f-4928-b167-eded146e6f65 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1808 microversion: 2.20 time: 0.416642 Nov 16 16:07:10.917816 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 259/553] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:07:10 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1808 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:07:10.920357 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-563c2890-c80a-4c0d-bda8-dc3c606331c9 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:10.920966 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-563c2890-c80a-4c0d-bda8-dc3c606331c9 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:10.939824 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-563c2890-c80a-4c0d-bda8-dc3c606331c9 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:10.943290 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-563c2890-c80a-4c0d-bda8-dc3c606331c9 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:10.944346 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-563c2890-c80a-4c0d-bda8-dc3c606331c9 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:10.952337 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-563c2890-c80a-4c0d-bda8-dc3c606331c9 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:11.498905 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-563c2890-c80a-4c0d-bda8-dc3c606331c9 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:11.510430 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-563c2890-c80a-4c0d-bda8-dc3c606331c9 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1522 microversion: 2.1 time: 0.593992 Nov 16 16:07:11.511780 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 295/554] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:10 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1522 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:11.937686 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-26486863-4749-41e2-9844-24ad706e3ff1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:11.938557 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-26486863-4749-41e2-9844-24ad706e3ff1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:11.950171 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-26486863-4749-41e2-9844-24ad706e3ff1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:11.951875 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-26486863-4749-41e2-9844-24ad706e3ff1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:11.954268 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-26486863-4749-41e2-9844-24ad706e3ff1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:11.954864 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-26486863-4749-41e2-9844-24ad706e3ff1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:12.210716 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-26486863-4749-41e2-9844-24ad706e3ff1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:12.222758 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-26486863-4749-41e2-9844-24ad706e3ff1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:12.224380 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-26486863-4749-41e2-9844-24ad706e3ff1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:12.225733 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-26486863-4749-41e2-9844-24ad706e3ff1 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1808 microversion: 2.20 time: 0.292186 Nov 16 16:07:12.227175 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 260/555] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:07:11 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1808 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:07:12.528809 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-9c3178cc-9801-41e4-98b6-318005eb03ba tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:12.529409 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-9c3178cc-9801-41e4-98b6-318005eb03ba tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:12.540615 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9c3178cc-9801-41e4-98b6-318005eb03ba tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:12.541432 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9c3178cc-9801-41e4-98b6-318005eb03ba tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:12.542470 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9c3178cc-9801-41e4-98b6-318005eb03ba tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:12.543376 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9c3178cc-9801-41e4-98b6-318005eb03ba tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:13.025562 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-9c3178cc-9801-41e4-98b6-318005eb03ba tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:13.040412 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-9c3178cc-9801-41e4-98b6-318005eb03ba tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1522 microversion: 2.1 time: 0.515823 Nov 16 16:07:13.041626 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 296/556] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:12 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1522 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:13.077855 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-44e3d4ab-44bb-4bab-9d19-31cec50fe40e req-2b31c198-ccd2-4696-b169-a7ed9565ed3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6447972e-6291-4e68-8271-c93523206230", "name": "network-vif-plugged", "status": "completed", "tag": "68ede3d7-0ef4-42a4-b3de-ef6046161db6"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:07:13.080220 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:07:13.080220 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Nov 16 16:07:13.099875 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-44e3d4ab-44bb-4bab-9d19-31cec50fe40e req-2b31c198-ccd2-4696-b169-a7ed9565ed3e service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:13.100567 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-44e3d4ab-44bb-4bab-9d19-31cec50fe40e req-2b31c198-ccd2-4696-b169-a7ed9565ed3e service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:13.127562 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-44e3d4ab-44bb-4bab-9d19-31cec50fe40e req-2b31c198-ccd2-4696-b169-a7ed9565ed3e service nova] Creating event network-vif-plugged:68ede3d7-0ef4-42a4-b3de-ef6046161db6 for instance 6447972e-6291-4e68-8271-c93523206230 on hv-cinder-81809 Nov 16 16:07:13.141144 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-44e3d4ab-44bb-4bab-9d19-31cec50fe40e req-2b31c198-ccd2-4696-b169-a7ed9565ed3e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067383 Nov 16 16:07:13.141766 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 261/557] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:07:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:07:13.248100 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d9a5065d-380d-4da0-9729-0e9d7c30d0f4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:13.249114 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d9a5065d-380d-4da0-9729-0e9d7c30d0f4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:13.263511 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d9a5065d-380d-4da0-9729-0e9d7c30d0f4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:13.271250 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d9a5065d-380d-4da0-9729-0e9d7c30d0f4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:13.272625 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d9a5065d-380d-4da0-9729-0e9d7c30d0f4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:13.273282 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d9a5065d-380d-4da0-9729-0e9d7c30d0f4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:13.586604 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d9a5065d-380d-4da0-9729-0e9d7c30d0f4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:13.597869 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d9a5065d-380d-4da0-9729-0e9d7c30d0f4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:13.599647 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d9a5065d-380d-4da0-9729-0e9d7c30d0f4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:13.603438 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d9a5065d-380d-4da0-9729-0e9d7c30d0f4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1808 microversion: 2.20 time: 0.358955 Nov 16 16:07:13.607958 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 297/558] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:07:13 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1808 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:07:14.062415 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-08cf2272-1d03-4c9a-999e-f1c81f56f346 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:14.063040 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-08cf2272-1d03-4c9a-999e-f1c81f56f346 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:14.074185 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-08cf2272-1d03-4c9a-999e-f1c81f56f346 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:14.074623 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-08cf2272-1d03-4c9a-999e-f1c81f56f346 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:14.075440 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-08cf2272-1d03-4c9a-999e-f1c81f56f346 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:14.075892 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-08cf2272-1d03-4c9a-999e-f1c81f56f346 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:14.229185 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-08cf2272-1d03-4c9a-999e-f1c81f56f346 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:14.236958 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-08cf2272-1d03-4c9a-999e-f1c81f56f346 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1522 microversion: 2.1 time: 0.178487 Nov 16 16:07:14.237686 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 262/559] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:14 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:07:14.626193 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f579d277-7acf-4e8b-a14b-7c34f161a3e6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:14.626782 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f579d277-7acf-4e8b-a14b-7c34f161a3e6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:14.636067 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f579d277-7acf-4e8b-a14b-7c34f161a3e6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:14.636850 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f579d277-7acf-4e8b-a14b-7c34f161a3e6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:14.638445 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f579d277-7acf-4e8b-a14b-7c34f161a3e6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:14.639563 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f579d277-7acf-4e8b-a14b-7c34f161a3e6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:14.847558 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f579d277-7acf-4e8b-a14b-7c34f161a3e6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:14.876162 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f579d277-7acf-4e8b-a14b-7c34f161a3e6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:14.884187 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f579d277-7acf-4e8b-a14b-7c34f161a3e6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:14.885725 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f579d277-7acf-4e8b-a14b-7c34f161a3e6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1808 microversion: 2.20 time: 0.263503 Nov 16 16:07:14.886483 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 298/560] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:07:14 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1808 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:07:15.255322 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-5e39ee06-53aa-4a45-a14d-9c6fa53aa874 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:15.256017 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-5e39ee06-53aa-4a45-a14d-9c6fa53aa874 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:15.269966 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5e39ee06-53aa-4a45-a14d-9c6fa53aa874 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:15.270410 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5e39ee06-53aa-4a45-a14d-9c6fa53aa874 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:15.271198 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5e39ee06-53aa-4a45-a14d-9c6fa53aa874 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:15.280186 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5e39ee06-53aa-4a45-a14d-9c6fa53aa874 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:15.480513 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-5e39ee06-53aa-4a45-a14d-9c6fa53aa874 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:15.489651 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-5e39ee06-53aa-4a45-a14d-9c6fa53aa874 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1522 microversion: 2.1 time: 0.238671 Nov 16 16:07:15.499225 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 263/561] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:15 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:15.908427 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-bd6ff2ab-c3f5-495d-8b19-ed91671b19bc tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:15.911330 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-bd6ff2ab-c3f5-495d-8b19-ed91671b19bc tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:15.918659 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bd6ff2ab-c3f5-495d-8b19-ed91671b19bc tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:15.919192 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bd6ff2ab-c3f5-495d-8b19-ed91671b19bc tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:15.920193 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bd6ff2ab-c3f5-495d-8b19-ed91671b19bc tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:15.920652 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bd6ff2ab-c3f5-495d-8b19-ed91671b19bc tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:16.134467 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-bd6ff2ab-c3f5-495d-8b19-ed91671b19bc tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:16.147868 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-bd6ff2ab-c3f5-495d-8b19-ed91671b19bc tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:16.149555 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-bd6ff2ab-c3f5-495d-8b19-ed91671b19bc tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:16.150851 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-bd6ff2ab-c3f5-495d-8b19-ed91671b19bc tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1808 microversion: 2.20 time: 0.247572 Nov 16 16:07:16.151832 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 299/562] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:07:15 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1808 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:07:16.507182 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-537e4e06-ff45-4865-a141-35f4c199753a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:16.507801 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-537e4e06-ff45-4865-a141-35f4c199753a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:16.522216 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-537e4e06-ff45-4865-a141-35f4c199753a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:16.522668 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-537e4e06-ff45-4865-a141-35f4c199753a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:16.523902 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-537e4e06-ff45-4865-a141-35f4c199753a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:16.524605 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-537e4e06-ff45-4865-a141-35f4c199753a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:16.878695 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-537e4e06-ff45-4865-a141-35f4c199753a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:16.888020 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-537e4e06-ff45-4865-a141-35f4c199753a tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1522 microversion: 2.1 time: 0.385366 Nov 16 16:07:16.888609 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 264/563] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:16 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1522 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:17.171585 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-9406869d-4e12-4a1e-aa19-9de5487f937a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:17.172232 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-9406869d-4e12-4a1e-aa19-9de5487f937a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:17.186030 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9406869d-4e12-4a1e-aa19-9de5487f937a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:17.193810 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9406869d-4e12-4a1e-aa19-9de5487f937a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:17.195281 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9406869d-4e12-4a1e-aa19-9de5487f937a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:17.196511 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9406869d-4e12-4a1e-aa19-9de5487f937a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:17.603729 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-0cd45ea6-e019-4ed9-a57e-77667de08ade req-b40813c4-e742-497a-9c3a-a620521004bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69df60e2-42c9-4caa-abdc-a7ecb61d8d73", "name": "network-vif-deleted", "tag": "8d515f5e-ebe4-404a-a99d-1abd2b9d5bcc"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:07:17.606218 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:07:17.606218 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Nov 16 16:07:17.615165 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-0cd45ea6-e019-4ed9-a57e-77667de08ade req-b40813c4-e742-497a-9c3a-a620521004bb service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:17.615917 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-0cd45ea6-e019-4ed9-a57e-77667de08ade req-b40813c4-e742-497a-9c3a-a620521004bb service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:17.639315 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-9406869d-4e12-4a1e-aa19-9de5487f937a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:17.650796 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-0cd45ea6-e019-4ed9-a57e-77667de08ade req-b40813c4-e742-497a-9c3a-a620521004bb service nova] Creating event network-vif-deleted:8d515f5e-ebe4-404a-a99d-1abd2b9d5bcc for instance 69df60e2-42c9-4caa-abdc-a7ecb61d8d73 on hv-cinder-81809 Nov 16 16:07:17.653433 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-9406869d-4e12-4a1e-aa19-9de5487f937a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:17.655299 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-9406869d-4e12-4a1e-aa19-9de5487f937a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:17.656603 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-9406869d-4e12-4a1e-aa19-9de5487f937a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1808 microversion: 2.20 time: 0.491145 Nov 16 16:07:17.657176 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-0cd45ea6-e019-4ed9-a57e-77667de08ade req-b40813c4-e742-497a-9c3a-a620521004bb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063629 Nov 16 16:07:17.658340 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 265/564] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:07:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:07:17.662791 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 300/565] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:07:17 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1808 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:07:17.910968 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-38532882-0a0c-46bf-bd61-bd4d5d871c26 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:17.911757 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-38532882-0a0c-46bf-bd61-bd4d5d871c26 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:17.920991 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-38532882-0a0c-46bf-bd61-bd4d5d871c26 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:17.923771 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-38532882-0a0c-46bf-bd61-bd4d5d871c26 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:17.930290 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-38532882-0a0c-46bf-bd61-bd4d5d871c26 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:17.931897 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-38532882-0a0c-46bf-bd61-bd4d5d871c26 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:17.982486 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-38532882-0a0c-46bf-bd61-bd4d5d871c26 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:17.983414 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-38532882-0a0c-46bf-bd61-bd4d5d871c26 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:17.984409 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.objects.instance [None req-38532882-0a0c-46bf-bd61-bd4d5d871c26 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lazy-loading 'fault' on Instance uuid 69df60e2-42c9-4caa-abdc-a7ecb61d8d73 {{(pid=116085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:07:18.041282 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-38532882-0a0c-46bf-bd61-bd4d5d871c26 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec73bbd7f56e4c1887672a6f1e213377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29515163ad924903a1d1f653c9f77ee0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:18.050334 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-38532882-0a0c-46bf-bd61-bd4d5d871c26 tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 200 len: 1312 microversion: 2.1 time: 0.148075 Nov 16 16:07:18.052477 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 266/566] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:17 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 1312 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:18.680818 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1bd65b04-4869-4307-8280-2f2406530ce8 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:18.681407 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1bd65b04-4869-4307-8280-2f2406530ce8 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:18.687875 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1bd65b04-4869-4307-8280-2f2406530ce8 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:18.688584 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1bd65b04-4869-4307-8280-2f2406530ce8 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:18.689684 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1bd65b04-4869-4307-8280-2f2406530ce8 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:18.690689 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1bd65b04-4869-4307-8280-2f2406530ce8 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:18.857047 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1bd65b04-4869-4307-8280-2f2406530ce8 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:18.873176 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1bd65b04-4869-4307-8280-2f2406530ce8 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:18.875202 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1bd65b04-4869-4307-8280-2f2406530ce8 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:18.876468 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1bd65b04-4869-4307-8280-2f2406530ce8 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1795 microversion: 2.20 time: 0.199247 Nov 16 16:07:18.877010 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 301/567] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:07:18 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1795 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:07:19.069998 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-94e91872-5f44-4aa2-b0c7-fa4c5a20b21c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:19.070587 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-94e91872-5f44-4aa2-b0c7-fa4c5a20b21c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] [instance: 69df60e2-42c9-4caa-abdc-a7ecb61d8d73] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:19.077236 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-94e91872-5f44-4aa2-b0c7-fa4c5a20b21c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:19.077991 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-94e91872-5f44-4aa2-b0c7-fa4c5a20b21c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:19.078224 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-94e91872-5f44-4aa2-b0c7-fa4c5a20b21c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:19.079174 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-94e91872-5f44-4aa2-b0c7-fa4c5a20b21c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:19.095744 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.wsgi [None req-94e91872-5f44-4aa2-b0c7-fa4c5a20b21c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] HTTP exception thrown: Instance 69df60e2-42c9-4caa-abdc-a7ecb61d8d73 could not be found. Nov 16 16:07:19.097140 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-94e91872-5f44-4aa2-b0c7-fa4c5a20b21c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] Returning 404 to user: Instance 69df60e2-42c9-4caa-abdc-a7ecb61d8d73 could not be found. {{(pid=116085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:07:19.098383 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-94e91872-5f44-4aa2-b0c7-fa4c5a20b21c tempest-ServerRescueNegativeTestJSON-1158923208 tempest-ServerRescueNegativeTestJSON-1158923208-project] 10.222.0.46 "GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73" status: 404 len: 111 microversion: 2.1 time: 0.033765 Nov 16 16:07:19.099109 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 267/568] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:19 2021] GET /compute/v2.1/servers/69df60e2-42c9-4caa-abdc-a7ecb61d8d73 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:07:23.485519 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-469921a4-f010-4c22-8b3e-7f3fc643a415 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aea38eba-c84b-4b14-937e-ef95ab8bc563", "device": "/dev/sdb"}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:07:23.489898 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-469921a4-f010-4c22-8b3e-7f3fc643a415 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] [instance: be30cc01-fa20-42f1-80d2-a8becb9a7e2f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:23.503724 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-469921a4-f010-4c22-8b3e-7f3fc643a415 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:23.504044 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-469921a4-f010-4c22-8b3e-7f3fc643a415 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:23.508632 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-469921a4-f010-4c22-8b3e-7f3fc643a415 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:23.509124 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-469921a4-f010-4c22-8b3e-7f3fc643a415 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:23.841250 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-469921a4-f010-4c22-8b3e-7f3fc643a415 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] 10.222.0.46 "POST /compute/v2.1/servers/be30cc01-fa20-42f1-80d2-a8becb9a7e2f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.359839 Nov 16 16:07:23.842170 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 302/569] 10.222.0.46 () {60 vars in 1322 bytes} [Tue Nov 16 16:07:23 2021] POST /compute/v2.1/servers/be30cc01-fa20-42f1-80d2-a8becb9a7e2f/os-volume_attachments => generated 194 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:07:24.929511 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 16 16:07:24.930207 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: Tue Nov 16 16:07:24 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 16 16:07:25.072195 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-f522f18a-b94f-4e93-af9f-2186195a9f94 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Action: 'create', calling method: .version_select at 0x7f113c5ed3a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-751069602"}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:07:25.086270 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-f522f18a-b94f-4e93-af9f-2186195a9f94 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Getting quotas for project e31ed7321198471eb4645081b697d234. Resources: {'key_pairs'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:07:25.090017 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-f522f18a-b94f-4e93-af9f-2186195a9f94 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Getting quotas for user e2a73e3dbb5a4da5976643ad8224f56e and project e31ed7321198471eb4645081b697d234. Resources: {'key_pairs'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:07:25.394888 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-f522f18a-b94f-4e93-af9f-2186195a9f94 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Getting quotas for project e31ed7321198471eb4645081b697d234. Resources: {'key_pairs'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:07:25.398480 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-f522f18a-b94f-4e93-af9f-2186195a9f94 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Getting quotas for user e2a73e3dbb5a4da5976643ad8224f56e and project e31ed7321198471eb4645081b697d234. Resources: {'key_pairs'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:07:25.411659 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-f522f18a-b94f-4e93-af9f-2186195a9f94 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.343723 Nov 16 16:07:25.412256 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 268/570] 10.222.0.46 () {60 vars in 1157 bytes} [Tue Nov 16 16:07:25 2021] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:25.507996 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-8c97ea56-12a3-4d2a-81f1-d0c65626d34c tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1617550361", "imageRef": "526aacb2-a819-421c-a7c3-4a1ec909c56b", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-751069602", "networks": [{"uuid": "5a89a656-9dec-4820-a1cb-7b2fd3fcad27"}]}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:07:25.558238 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.network.neutron [None req-8c97ea56-12a3-4d2a-81f1-d0c65626d34c tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] validate_networks() for [('5a89a656-9dec-4820-a1cb-7b2fd3fcad27', None, None, None, None, None)] {{(pid=116084) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 16:07:25.925734 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-8c97ea56-12a3-4d2a-81f1-d0c65626d34c tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Flavor limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 16:07:25.926160 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-8c97ea56-12a3-4d2a-81f1-d0c65626d34c tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Image limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 16:07:25.926635 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-8c97ea56-12a3-4d2a-81f1-d0c65626d34c tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Flavor pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 16:07:25.927049 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-8c97ea56-12a3-4d2a-81f1-d0c65626d34c tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Image pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 16:07:25.927472 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-8c97ea56-12a3-4d2a-81f1-d0c65626d34c tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 16:07:25.936218 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8c97ea56-12a3-4d2a-81f1-d0c65626d34c tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:25.936792 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8c97ea56-12a3-4d2a-81f1-d0c65626d34c tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:25.937471 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8c97ea56-12a3-4d2a-81f1-d0c65626d34c tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:25.937910 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8c97ea56-12a3-4d2a-81f1-d0c65626d34c tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:25.954814 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-8c97ea56-12a3-4d2a-81f1-d0c65626d34c tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Getting quotas for project e31ed7321198471eb4645081b697d234. Resources: {'instances', 'ram', 'cores'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:07:25.958766 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-8c97ea56-12a3-4d2a-81f1-d0c65626d34c tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Getting quotas for user e2a73e3dbb5a4da5976643ad8224f56e and project e31ed7321198471eb4645081b697d234. Resources: {'instances', 'ram', 'cores'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:07:25.969846 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-8c97ea56-12a3-4d2a-81f1-d0c65626d34c tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Going to run 1 instances... {{(pid=116084) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 16:07:25.972846 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-8c97ea56-12a3-4d2a-81f1-d0c65626d34c tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='526aacb2-a819-421c-a7c3-4a1ec909c56b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116084) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 16:07:26.017098 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-8c97ea56-12a3-4d2a-81f1-d0c65626d34c tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.513445 Nov 16 16:07:26.022408 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 303/571] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 16 16:07:25 2021] POST /compute/v2.1/servers => generated 380 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 16:07:26.028246 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-d3f073df-acc6-4da2-a89d-2d4800d0500f tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:26.029576 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-d3f073df-acc6-4da2-a89d-2d4800d0500f tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:26.084905 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e2e0e2c5-830f-4305-971a-c312e7e8e8c0 tempest-VolumesTestJSON-982574365 tempest-VolumesTestJSON-982574365-project] Calling method '.version_select at 0x7f113c411dc0>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:26.102682 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-d3f073df-acc6-4da2-a89d-2d4800d0500f tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a73e3dbb5a4da5976643ad8224f56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ed7321198471eb4645081b697d234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:26.113927 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-d3f073df-acc6-4da2-a89d-2d4800d0500f tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d" status: 200 len: 1258 microversion: 2.1 time: 0.089818 Nov 16 16:07:26.114772 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 269/572] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:26 2021] GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d => generated 1258 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:26.137827 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e2e0e2c5-830f-4305-971a-c312e7e8e8c0 tempest-VolumesTestJSON-982574365 tempest-VolumesTestJSON-982574365-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/0e40bfb6-b94f-485b-bbe8-d02f3595454e" status: 200 len: 349 microversion: 2.1 time: 0.056527 Nov 16 16:07:26.138393 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 304/573] 10.222.0.46 () {58 vars in 1244 bytes} [Tue Nov 16 16:07:26 2021] GET /compute/v2.1/os-volumes/0e40bfb6-b94f-485b-bbe8-d02f3595454e => generated 349 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:07:27.131125 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-5ce35f92-9f71-46bf-9e96-d00cc26a5a25 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:27.132495 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-5ce35f92-9f71-46bf-9e96-d00cc26a5a25 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:27.141100 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5ce35f92-9f71-46bf-9e96-d00cc26a5a25 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:27.141610 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5ce35f92-9f71-46bf-9e96-d00cc26a5a25 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:27.142886 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5ce35f92-9f71-46bf-9e96-d00cc26a5a25 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:27.144066 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5ce35f92-9f71-46bf-9e96-d00cc26a5a25 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:27.227614 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-5ce35f92-9f71-46bf-9e96-d00cc26a5a25 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a73e3dbb5a4da5976643ad8224f56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ed7321198471eb4645081b697d234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:27.234790 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-5ce35f92-9f71-46bf-9e96-d00cc26a5a25 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d" status: 200 len: 1316 microversion: 2.1 time: 0.107949 Nov 16 16:07:27.235439 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 270/574] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:27 2021] GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d => generated 1316 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:27.470166 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-70620405-1212-4de3-95ca-ca1f9ca5ed25 tempest-VolumesTestJSON-982574365 tempest-VolumesTestJSON-982574365-project] Calling method '.version_select at 0x7f113c5c9160>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:27.519209 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-70620405-1212-4de3-95ca-ca1f9ca5ed25 tempest-VolumesTestJSON-982574365 tempest-VolumesTestJSON-982574365-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/898dae79-55bf-4c1a-bf2d-8d09c0e04ba2" status: 200 len: 350 microversion: 2.1 time: 0.053659 Nov 16 16:07:27.520163 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 305/575] 10.222.0.46 () {58 vars in 1244 bytes} [Tue Nov 16 16:07:27 2021] GET /compute/v2.1/os-volumes/898dae79-55bf-4c1a-bf2d-8d09c0e04ba2 => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:07:28.255046 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-1c106420-a45c-4997-a1aa-fb695ff1fe41 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:28.256694 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-1c106420-a45c-4997-a1aa-fb695ff1fe41 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:28.266903 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1c106420-a45c-4997-a1aa-fb695ff1fe41 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:28.267942 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1c106420-a45c-4997-a1aa-fb695ff1fe41 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:28.269816 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1c106420-a45c-4997-a1aa-fb695ff1fe41 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:28.270644 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1c106420-a45c-4997-a1aa-fb695ff1fe41 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:28.426022 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-1c106420-a45c-4997-a1aa-fb695ff1fe41 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a73e3dbb5a4da5976643ad8224f56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ed7321198471eb4645081b697d234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:28.433197 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-1c106420-a45c-4997-a1aa-fb695ff1fe41 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d" status: 200 len: 1358 microversion: 2.1 time: 0.183643 Nov 16 16:07:28.433754 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 271/576] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:28 2021] GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:29.001599 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-91e2f858-93be-4a27-9ae6-0a717d40d1e8 tempest-VolumesTestJSON-982574365 tempest-VolumesTestJSON-982574365-project] Calling method '.version_select at 0x7f113cff48b0>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:29.048341 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-91e2f858-93be-4a27-9ae6-0a717d40d1e8 tempest-VolumesTestJSON-982574365 tempest-VolumesTestJSON-982574365-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/ef80bbfc-c009-4623-86cd-654bfbefc719" status: 200 len: 349 microversion: 2.1 time: 0.050735 Nov 16 16:07:29.049052 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 306/577] 10.222.0.46 () {58 vars in 1244 bytes} [Tue Nov 16 16:07:28 2021] GET /compute/v2.1/os-volumes/ef80bbfc-c009-4623-86cd-654bfbefc719 => generated 349 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:07:29.059749 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-949d5a4a-2720-4225-a1e7-5547eec361b5 tempest-VolumesTestJSON-982574365 tempest-VolumesTestJSON-982574365-project] Calling method '.version_select at 0x7f113c7021f0>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:29.139545 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-949d5a4a-2720-4225-a1e7-5547eec361b5 tempest-VolumesTestJSON-982574365 tempest-VolumesTestJSON-982574365-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1031 microversion: 2.1 time: 0.083214 Nov 16 16:07:29.140239 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 272/578] 10.222.0.46 () {58 vars in 1133 bytes} [Tue Nov 16 16:07:29 2021] GET /compute/v2.1/os-volumes => generated 1031 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:29.152546 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b9f23098-c10c-4250-aa8f-a6a8f6576a81 tempest-VolumesTestJSON-982574365 tempest-VolumesTestJSON-982574365-project] Calling method '.version_select at 0x7f113cf6c700>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:29.235023 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b9f23098-c10c-4250-aa8f-a6a8f6576a81 tempest-VolumesTestJSON-982574365 tempest-VolumesTestJSON-982574365-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.086217 Nov 16 16:07:29.235690 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 307/579] 10.222.0.46 () {58 vars in 1148 bytes} [Tue Nov 16 16:07:29 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 692 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:07:29.247825 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-49175ed0-1468-40a5-9ead-0e7355643870 tempest-VolumesTestJSON-982574365 tempest-VolumesTestJSON-982574365-project] Calling method '.version_select at 0x7f113c5d1ee0>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:29.335736 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-49175ed0-1468-40a5-9ead-0e7355643870 tempest-VolumesTestJSON-982574365 tempest-VolumesTestJSON-982574365-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1031 microversion: 2.1 time: 0.091460 Nov 16 16:07:29.336937 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 273/580] 10.222.0.46 () {58 vars in 1133 bytes} [Tue Nov 16 16:07:29 2021] GET /compute/v2.1/os-volumes => generated 1031 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:29.348311 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1d491e7e-60aa-4a4f-b7f2-323619e930f5 tempest-VolumesTestJSON-982574365 tempest-VolumesTestJSON-982574365-project] Calling method '.version_select at 0x7f113c4521f0>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:29.427658 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1d491e7e-60aa-4a4f-b7f2-323619e930f5 tempest-VolumesTestJSON-982574365 tempest-VolumesTestJSON-982574365-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.083368 Nov 16 16:07:29.428251 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 308/581] 10.222.0.46 () {58 vars in 1166 bytes} [Tue Nov 16 16:07:29 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:07:29.440595 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-5eaffef6-05ac-48f9-9755-cc4674a82f7e tempest-VolumesTestJSON-982574365 tempest-VolumesTestJSON-982574365-project] Calling method '.version_select at 0x7f113c4ca5e0>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:29.449831 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-db82aba8-11c4-480e-8462-d4239ba12600 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:29.450774 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-db82aba8-11c4-480e-8462-d4239ba12600 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:29.458300 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-db82aba8-11c4-480e-8462-d4239ba12600 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:29.459099 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-db82aba8-11c4-480e-8462-d4239ba12600 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:29.461357 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-db82aba8-11c4-480e-8462-d4239ba12600 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:29.462015 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-db82aba8-11c4-480e-8462-d4239ba12600 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:29.535176 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-5eaffef6-05ac-48f9-9755-cc4674a82f7e tempest-VolumesTestJSON-982574365 tempest-VolumesTestJSON-982574365-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.097740 Nov 16 16:07:29.536504 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 274/582] 10.222.0.46 () {58 vars in 1169 bytes} [Tue Nov 16 16:07:29 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 692 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:07:29.550088 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-5df9daee-ffee-4c8b-81cd-bf101c7ab56e tempest-VolumesTestJSON-982574365 tempest-VolumesTestJSON-982574365-project] Calling method '.version_select at 0x7f113c648b80>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:29.624762 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-db82aba8-11c4-480e-8462-d4239ba12600 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a73e3dbb5a4da5976643ad8224f56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ed7321198471eb4645081b697d234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:29.632705 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-db82aba8-11c4-480e-8462-d4239ba12600 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d" status: 200 len: 1358 microversion: 2.1 time: 0.186520 Nov 16 16:07:29.633804 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 309/583] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:29 2021] GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:07:29.636347 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-5df9daee-ffee-4c8b-81cd-bf101c7ab56e tempest-VolumesTestJSON-982574365 tempest-VolumesTestJSON-982574365-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1031 microversion: 2.1 time: 0.090013 Nov 16 16:07:29.637151 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 275/584] 10.222.0.46 () {58 vars in 1154 bytes} [Tue Nov 16 16:07:29 2021] GET /compute/v2.1/os-volumes/detail => generated 1031 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:07:29.656210 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b483deb3-a376-4c2a-94f9-003d94898a29 tempest-VolumesTestJSON-982574365 tempest-VolumesTestJSON-982574365-project] Calling method '.version_select at 0x7f113c583160>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:29.740963 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b483deb3-a376-4c2a-94f9-003d94898a29 tempest-VolumesTestJSON-982574365 tempest-VolumesTestJSON-982574365-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.089712 Nov 16 16:07:29.741603 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 310/585] 10.222.0.46 () {58 vars in 1187 bytes} [Tue Nov 16 16:07:29 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:07:29.753506 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-61fba0fb-50bc-45b4-a3a9-e5506bdf7e62 tempest-VolumesTestJSON-982574365 tempest-VolumesTestJSON-982574365-project] Calling method '.version_select at 0x7f113c4d9dc0>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:29.832768 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-61fba0fb-50bc-45b4-a3a9-e5506bdf7e62 tempest-VolumesTestJSON-982574365 tempest-VolumesTestJSON-982574365-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1031 microversion: 2.1 time: 0.083385 Nov 16 16:07:29.833333 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 276/586] 10.222.0.46 () {58 vars in 1154 bytes} [Tue Nov 16 16:07:29 2021] GET /compute/v2.1/os-volumes/detail => generated 1031 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:30.650067 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-030f9d14-cb30-4b63-b79d-ec734e68a97d tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:30.650674 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-030f9d14-cb30-4b63-b79d-ec734e68a97d tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:30.657517 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-030f9d14-cb30-4b63-b79d-ec734e68a97d tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:30.657963 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-030f9d14-cb30-4b63-b79d-ec734e68a97d tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:30.658743 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-030f9d14-cb30-4b63-b79d-ec734e68a97d tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:30.659299 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-030f9d14-cb30-4b63-b79d-ec734e68a97d tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:30.794285 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-030f9d14-cb30-4b63-b79d-ec734e68a97d tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a73e3dbb5a4da5976643ad8224f56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ed7321198471eb4645081b697d234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:30.802592 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-030f9d14-cb30-4b63-b79d-ec734e68a97d tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d" status: 200 len: 1358 microversion: 2.1 time: 0.156560 Nov 16 16:07:30.803170 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 311/587] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:30 2021] GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:30.937537 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-ce16c81e-8e19-40dc-81e0-190ef19465ce tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:30.938057 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-ce16c81e-8e19-40dc-81e0-190ef19465ce tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:30.944759 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ce16c81e-8e19-40dc-81e0-190ef19465ce tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:30.945209 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ce16c81e-8e19-40dc-81e0-190ef19465ce tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:30.946010 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ce16c81e-8e19-40dc-81e0-190ef19465ce tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:30.946451 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ce16c81e-8e19-40dc-81e0-190ef19465ce tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:31.082736 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.objects.instance [None req-ce16c81e-8e19-40dc-81e0-190ef19465ce tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lazy-loading 'services' on Instance uuid 674c9e04-e56c-4891-adc1-7cdac0c8510f {{(pid=116085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:07:31.200708 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-ce16c81e-8e19-40dc-81e0-190ef19465ce tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "DELETE /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/os-volume_attachments/05c92bfb-7118-48a7-bcef-4292de71a9bd" status: 202 len: 0 microversion: 2.1 time: 0.267198 Nov 16 16:07:31.201230 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 277/588] 10.222.0.46 () {58 vars in 1415 bytes} [Tue Nov 16 16:07:30 2021] DELETE /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/os-volume_attachments/05c92bfb-7118-48a7-bcef-4292de71a9bd => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:07:31.819307 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ef70b2cc-7193-45a0-907a-f5315276f064 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:31.819949 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ef70b2cc-7193-45a0-907a-f5315276f064 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:31.826796 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ef70b2cc-7193-45a0-907a-f5315276f064 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:31.827247 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ef70b2cc-7193-45a0-907a-f5315276f064 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:31.828402 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ef70b2cc-7193-45a0-907a-f5315276f064 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:31.828842 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ef70b2cc-7193-45a0-907a-f5315276f064 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:31.964538 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ef70b2cc-7193-45a0-907a-f5315276f064 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a73e3dbb5a4da5976643ad8224f56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ed7321198471eb4645081b697d234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:31.972251 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ef70b2cc-7193-45a0-907a-f5315276f064 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d" status: 200 len: 1358 microversion: 2.1 time: 0.156736 Nov 16 16:07:31.972951 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 312/589] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:31 2021] GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:32.990171 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-838fd6f9-a1ed-4eb1-a0c5-ce5f4e8bf940 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:32.990782 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-838fd6f9-a1ed-4eb1-a0c5-ce5f4e8bf940 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:32.997291 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-838fd6f9-a1ed-4eb1-a0c5-ce5f4e8bf940 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:32.997735 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-838fd6f9-a1ed-4eb1-a0c5-ce5f4e8bf940 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:32.998540 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-838fd6f9-a1ed-4eb1-a0c5-ce5f4e8bf940 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:32.998973 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-838fd6f9-a1ed-4eb1-a0c5-ce5f4e8bf940 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:33.143109 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-838fd6f9-a1ed-4eb1-a0c5-ce5f4e8bf940 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a73e3dbb5a4da5976643ad8224f56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ed7321198471eb4645081b697d234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:33.150609 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-838fd6f9-a1ed-4eb1-a0c5-ce5f4e8bf940 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d" status: 200 len: 1358 microversion: 2.1 time: 0.165111 Nov 16 16:07:33.151162 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 278/590] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:32 2021] GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:34.167276 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-afc2b8cc-b74e-4549-9c37-cb4c05a634ff tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:34.167930 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-afc2b8cc-b74e-4549-9c37-cb4c05a634ff tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:34.174234 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-afc2b8cc-b74e-4549-9c37-cb4c05a634ff tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:34.174671 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-afc2b8cc-b74e-4549-9c37-cb4c05a634ff tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:34.175560 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-afc2b8cc-b74e-4549-9c37-cb4c05a634ff tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:34.175998 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-afc2b8cc-b74e-4549-9c37-cb4c05a634ff tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:34.357636 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-afc2b8cc-b74e-4549-9c37-cb4c05a634ff tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a73e3dbb5a4da5976643ad8224f56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ed7321198471eb4645081b697d234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:34.366803 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-afc2b8cc-b74e-4549-9c37-cb4c05a634ff tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d" status: 200 len: 1358 microversion: 2.1 time: 0.202917 Nov 16 16:07:34.367399 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 313/591] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:34 2021] GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d => generated 1358 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:35.384464 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-0d05aabc-0305-4858-a696-f1d1f3b9e835 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:35.385284 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-0d05aabc-0305-4858-a696-f1d1f3b9e835 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:35.391424 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0d05aabc-0305-4858-a696-f1d1f3b9e835 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:35.391796 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0d05aabc-0305-4858-a696-f1d1f3b9e835 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:35.398056 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0d05aabc-0305-4858-a696-f1d1f3b9e835 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:35.398561 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0d05aabc-0305-4858-a696-f1d1f3b9e835 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:35.584235 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-0d05aabc-0305-4858-a696-f1d1f3b9e835 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a73e3dbb5a4da5976643ad8224f56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ed7321198471eb4645081b697d234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:35.592648 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-0d05aabc-0305-4858-a696-f1d1f3b9e835 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d" status: 200 len: 1358 microversion: 2.1 time: 0.212028 Nov 16 16:07:35.593315 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 279/592] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:35 2021] GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d => generated 1358 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:36.610040 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f5ba3119-ce2b-4092-b270-cd26a4a5ba5d tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:36.610621 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f5ba3119-ce2b-4092-b270-cd26a4a5ba5d tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:36.618252 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f5ba3119-ce2b-4092-b270-cd26a4a5ba5d tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:36.619084 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f5ba3119-ce2b-4092-b270-cd26a4a5ba5d tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:36.620125 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f5ba3119-ce2b-4092-b270-cd26a4a5ba5d tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:36.620757 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f5ba3119-ce2b-4092-b270-cd26a4a5ba5d tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:36.844781 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f5ba3119-ce2b-4092-b270-cd26a4a5ba5d tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a73e3dbb5a4da5976643ad8224f56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ed7321198471eb4645081b697d234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:36.852151 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f5ba3119-ce2b-4092-b270-cd26a4a5ba5d tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d" status: 200 len: 1358 microversion: 2.1 time: 0.245903 Nov 16 16:07:36.862351 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 314/593] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:36 2021] GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d => generated 1358 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:07:37.869438 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-ccb5d5b4-2d4f-427e-8f03-de81efc4d178 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:37.870178 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-ccb5d5b4-2d4f-427e-8f03-de81efc4d178 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:37.878210 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ccb5d5b4-2d4f-427e-8f03-de81efc4d178 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:37.879053 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ccb5d5b4-2d4f-427e-8f03-de81efc4d178 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:37.880292 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ccb5d5b4-2d4f-427e-8f03-de81efc4d178 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:37.880984 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ccb5d5b4-2d4f-427e-8f03-de81efc4d178 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:38.035928 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-ccb5d5b4-2d4f-427e-8f03-de81efc4d178 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a73e3dbb5a4da5976643ad8224f56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ed7321198471eb4645081b697d234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:38.059770 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-ccb5d5b4-2d4f-427e-8f03-de81efc4d178 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d" status: 200 len: 1358 microversion: 2.1 time: 0.194201 Nov 16 16:07:38.060484 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 280/594] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:37 2021] GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:39.077392 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-4f004e80-4bf7-4939-b53c-06f853ff6b88 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:39.077951 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-4f004e80-4bf7-4939-b53c-06f853ff6b88 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:39.084265 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4f004e80-4bf7-4939-b53c-06f853ff6b88 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:39.084711 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4f004e80-4bf7-4939-b53c-06f853ff6b88 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:39.085487 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4f004e80-4bf7-4939-b53c-06f853ff6b88 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:39.085926 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4f004e80-4bf7-4939-b53c-06f853ff6b88 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:39.214261 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-4f004e80-4bf7-4939-b53c-06f853ff6b88 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a73e3dbb5a4da5976643ad8224f56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ed7321198471eb4645081b697d234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:39.222040 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-4f004e80-4bf7-4939-b53c-06f853ff6b88 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d" status: 200 len: 1358 microversion: 2.1 time: 0.148423 Nov 16 16:07:39.222598 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 315/595] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:39 2021] GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:40.114644 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-6ee08481-c315-4d5c-b507-6ba90f09fdbf req-e04e9834-934f-47bb-9f66-460d918597c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5a9f9cd-86b0-4029-b3b3-c25470b8025d", "tag": "46c407d4-a5b9-4ded-af69-53e4b90a70c8"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:07:40.117003 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:07:40.117003 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Nov 16 16:07:40.144646 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-6ee08481-c315-4d5c-b507-6ba90f09fdbf req-e04e9834-934f-47bb-9f66-460d918597c1 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:40.145314 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-6ee08481-c315-4d5c-b507-6ba90f09fdbf req-e04e9834-934f-47bb-9f66-460d918597c1 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:40.160971 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-6ee08481-c315-4d5c-b507-6ba90f09fdbf req-e04e9834-934f-47bb-9f66-460d918597c1 service nova] Creating event network-changed:46c407d4-a5b9-4ded-af69-53e4b90a70c8 for instance c5a9f9cd-86b0-4029-b3b3-c25470b8025d on hv-cinder-81809 Nov 16 16:07:40.166602 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-6ee08481-c315-4d5c-b507-6ba90f09fdbf req-e04e9834-934f-47bb-9f66-460d918597c1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056118 Nov 16 16:07:40.167483 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 281/596] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:07:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:07:40.238739 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1cd0e484-7cad-4add-8834-43426a0ccaed tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:40.239300 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1cd0e484-7cad-4add-8834-43426a0ccaed tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:40.245967 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1cd0e484-7cad-4add-8834-43426a0ccaed tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:40.246883 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1cd0e484-7cad-4add-8834-43426a0ccaed tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:40.248028 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1cd0e484-7cad-4add-8834-43426a0ccaed tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:40.248621 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1cd0e484-7cad-4add-8834-43426a0ccaed tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:40.481871 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1cd0e484-7cad-4add-8834-43426a0ccaed tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a73e3dbb5a4da5976643ad8224f56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ed7321198471eb4645081b697d234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:40.506482 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1cd0e484-7cad-4add-8834-43426a0ccaed tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d" status: 200 len: 1358 microversion: 2.1 time: 0.271891 Nov 16 16:07:40.507895 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 316/597] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:40 2021] GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d => generated 1358 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:41.525140 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-b4ca7e90-9676-499d-8231-718162ee44ec tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:41.525866 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-b4ca7e90-9676-499d-8231-718162ee44ec tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:41.532477 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b4ca7e90-9676-499d-8231-718162ee44ec tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:41.532917 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b4ca7e90-9676-499d-8231-718162ee44ec tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:41.533689 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b4ca7e90-9676-499d-8231-718162ee44ec tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:41.534112 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b4ca7e90-9676-499d-8231-718162ee44ec tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:41.677895 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-b4ca7e90-9676-499d-8231-718162ee44ec tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a73e3dbb5a4da5976643ad8224f56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ed7321198471eb4645081b697d234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:41.685328 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-b4ca7e90-9676-499d-8231-718162ee44ec tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d" status: 200 len: 1358 microversion: 2.1 time: 0.164135 Nov 16 16:07:41.685897 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 282/598] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:41 2021] GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:41.852821 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b15f3ec7-eac9-42c2-b7da-a9a6054db3a1 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:07:41.859023 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b15f3ec7-eac9-42c2-b7da-a9a6054db3a1 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:41.859485 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b15f3ec7-eac9-42c2-b7da-a9a6054db3a1 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:41.883521 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b15f3ec7-eac9-42c2-b7da-a9a6054db3a1 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Going to try to stop instance {{(pid=116084) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 16 16:07:41.937238 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b15f3ec7-eac9-42c2-b7da-a9a6054db3a1 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action" status: 202 len: 0 microversion: 2.1 time: 0.087854 Nov 16 16:07:41.937963 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 317/599] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:07:41 2021] POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:07:41.947492 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-72d8b3e3-6295-49b3-a3b5-c3226b02f9d8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:41.948105 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-72d8b3e3-6295-49b3-a3b5-c3226b02f9d8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:41.953907 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-72d8b3e3-6295-49b3-a3b5-c3226b02f9d8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:41.954387 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-72d8b3e3-6295-49b3-a3b5-c3226b02f9d8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:41.955295 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-72d8b3e3-6295-49b3-a3b5-c3226b02f9d8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:41.955795 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-72d8b3e3-6295-49b3-a3b5-c3226b02f9d8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:42.093513 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-72d8b3e3-6295-49b3-a3b5-c3226b02f9d8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:42.101120 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-72d8b3e3-6295-49b3-a3b5-c3226b02f9d8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1674 microversion: 2.1 time: 0.157243 Nov 16 16:07:42.101832 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 283/600] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:41 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:42.703884 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-edf0f4b3-293a-4474-b0ad-a4743963dd91 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:42.704581 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-edf0f4b3-293a-4474-b0ad-a4743963dd91 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:42.711627 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-edf0f4b3-293a-4474-b0ad-a4743963dd91 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:42.712075 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-edf0f4b3-293a-4474-b0ad-a4743963dd91 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:42.712842 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-edf0f4b3-293a-4474-b0ad-a4743963dd91 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:42.713280 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-edf0f4b3-293a-4474-b0ad-a4743963dd91 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:42.924169 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-edf0f4b3-293a-4474-b0ad-a4743963dd91 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a73e3dbb5a4da5976643ad8224f56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ed7321198471eb4645081b697d234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:42.931481 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-edf0f4b3-293a-4474-b0ad-a4743963dd91 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d" status: 200 len: 1358 microversion: 2.1 time: 0.231614 Nov 16 16:07:42.932060 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 318/601] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:42 2021] GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d => generated 1358 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:43.118347 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-65306d5c-126e-40bf-af54-48d4b8ad067b tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:43.119118 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-65306d5c-126e-40bf-af54-48d4b8ad067b tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:43.125830 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-65306d5c-126e-40bf-af54-48d4b8ad067b tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:43.126269 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-65306d5c-126e-40bf-af54-48d4b8ad067b tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:43.127595 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-65306d5c-126e-40bf-af54-48d4b8ad067b tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:43.128635 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-65306d5c-126e-40bf-af54-48d4b8ad067b tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:43.272010 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-65306d5c-126e-40bf-af54-48d4b8ad067b tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:43.281872 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-65306d5c-126e-40bf-af54-48d4b8ad067b tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1674 microversion: 2.1 time: 0.166772 Nov 16 16:07:43.282867 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 284/602] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:43 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1674 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:43.947734 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a3ebb6d4-db75-4adb-b4cc-39101741af15 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:43.948361 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-a3ebb6d4-db75-4adb-b4cc-39101741af15 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:43.954764 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a3ebb6d4-db75-4adb-b4cc-39101741af15 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:43.955210 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a3ebb6d4-db75-4adb-b4cc-39101741af15 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:43.956763 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a3ebb6d4-db75-4adb-b4cc-39101741af15 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:43.957195 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a3ebb6d4-db75-4adb-b4cc-39101741af15 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:44.091300 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-a3ebb6d4-db75-4adb-b4cc-39101741af15 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a73e3dbb5a4da5976643ad8224f56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ed7321198471eb4645081b697d234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:44.099325 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-a3ebb6d4-db75-4adb-b4cc-39101741af15 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d" status: 200 len: 1358 microversion: 2.1 time: 0.155174 Nov 16 16:07:44.100126 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 319/603] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:43 2021] GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:44.299218 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-72c675a5-d9fc-406a-962b-fbf66aee82a3 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:44.300882 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-72c675a5-d9fc-406a-962b-fbf66aee82a3 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:44.307055 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-72c675a5-d9fc-406a-962b-fbf66aee82a3 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:44.307513 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-72c675a5-d9fc-406a-962b-fbf66aee82a3 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:44.308408 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-72c675a5-d9fc-406a-962b-fbf66aee82a3 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:44.308712 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-72c675a5-d9fc-406a-962b-fbf66aee82a3 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:44.445624 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-72c675a5-d9fc-406a-962b-fbf66aee82a3 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:44.453676 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-72c675a5-d9fc-406a-962b-fbf66aee82a3 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1674 microversion: 2.1 time: 0.158185 Nov 16 16:07:44.454257 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 285/604] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:44 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:45.115315 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b525f8c8-dbc3-4cee-9cdb-82b75c31d61f tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:45.115965 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b525f8c8-dbc3-4cee-9cdb-82b75c31d61f tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:45.122396 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b525f8c8-dbc3-4cee-9cdb-82b75c31d61f tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:45.122930 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b525f8c8-dbc3-4cee-9cdb-82b75c31d61f tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:45.123792 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b525f8c8-dbc3-4cee-9cdb-82b75c31d61f tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:45.124301 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b525f8c8-dbc3-4cee-9cdb-82b75c31d61f tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:45.261725 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b525f8c8-dbc3-4cee-9cdb-82b75c31d61f tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a73e3dbb5a4da5976643ad8224f56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ed7321198471eb4645081b697d234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:45.270189 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b525f8c8-dbc3-4cee-9cdb-82b75c31d61f tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d" status: 200 len: 1358 microversion: 2.1 time: 0.158692 Nov 16 16:07:45.270980 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 320/605] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:45 2021] GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:45.471612 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-643050b5-ed98-4422-af9a-1413899f63e6 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:45.472475 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-643050b5-ed98-4422-af9a-1413899f63e6 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:45.479378 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-643050b5-ed98-4422-af9a-1413899f63e6 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:45.480274 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-643050b5-ed98-4422-af9a-1413899f63e6 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:45.481695 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-643050b5-ed98-4422-af9a-1413899f63e6 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:45.482535 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-643050b5-ed98-4422-af9a-1413899f63e6 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:45.667301 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-643050b5-ed98-4422-af9a-1413899f63e6 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:45.676022 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-643050b5-ed98-4422-af9a-1413899f63e6 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1674 microversion: 2.1 time: 0.209051 Nov 16 16:07:45.676730 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 286/606] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:45 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1674 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:46.287642 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-499fe7f4-450b-46ec-ad91-238b26efeb5d tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:46.288243 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-499fe7f4-450b-46ec-ad91-238b26efeb5d tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:46.294901 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-499fe7f4-450b-46ec-ad91-238b26efeb5d tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:46.294901 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-499fe7f4-450b-46ec-ad91-238b26efeb5d tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:46.295781 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-499fe7f4-450b-46ec-ad91-238b26efeb5d tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:46.296197 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-499fe7f4-450b-46ec-ad91-238b26efeb5d tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:46.442760 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-499fe7f4-450b-46ec-ad91-238b26efeb5d tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a73e3dbb5a4da5976643ad8224f56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ed7321198471eb4645081b697d234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:46.450113 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-499fe7f4-450b-46ec-ad91-238b26efeb5d tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d" status: 200 len: 1358 microversion: 2.1 time: 0.166562 Nov 16 16:07:46.450983 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 321/607] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:46 2021] GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:46.692871 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-55a5ca05-f4ac-4e7a-aca9-66135207e6db tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:46.693612 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-55a5ca05-f4ac-4e7a-aca9-66135207e6db tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:46.701475 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-55a5ca05-f4ac-4e7a-aca9-66135207e6db tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:46.701926 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-55a5ca05-f4ac-4e7a-aca9-66135207e6db tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:46.702755 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-55a5ca05-f4ac-4e7a-aca9-66135207e6db tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:46.703191 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-55a5ca05-f4ac-4e7a-aca9-66135207e6db tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:46.854748 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-55a5ca05-f4ac-4e7a-aca9-66135207e6db tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:46.862609 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-55a5ca05-f4ac-4e7a-aca9-66135207e6db tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1674 microversion: 2.1 time: 0.174184 Nov 16 16:07:46.863177 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 287/608] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:46 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1674 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:47.468145 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-820b4d7c-9d12-4eba-84f0-7625e59c5ac8 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:47.468966 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-820b4d7c-9d12-4eba-84f0-7625e59c5ac8 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:47.476365 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-820b4d7c-9d12-4eba-84f0-7625e59c5ac8 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:47.476812 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-820b4d7c-9d12-4eba-84f0-7625e59c5ac8 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:47.477589 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-820b4d7c-9d12-4eba-84f0-7625e59c5ac8 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:47.478298 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-820b4d7c-9d12-4eba-84f0-7625e59c5ac8 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:47.608808 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-820b4d7c-9d12-4eba-84f0-7625e59c5ac8 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a73e3dbb5a4da5976643ad8224f56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ed7321198471eb4645081b697d234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:47.617257 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-820b4d7c-9d12-4eba-84f0-7625e59c5ac8 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d" status: 200 len: 1358 microversion: 2.1 time: 0.153553 Nov 16 16:07:47.617840 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 322/609] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:47 2021] GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:47.730281 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-38602ad5-7fa6-43fd-9da5-1ce4fce65b27 req-a04726bc-b495-4408-81d3-13f1c84f2d15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5a9f9cd-86b0-4029-b3b3-c25470b8025d", "name": "network-vif-plugged", "status": "completed", "tag": "46c407d4-a5b9-4ded-af69-53e4b90a70c8"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:07:47.732678 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:07:47.732678 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Nov 16 16:07:47.740872 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-38602ad5-7fa6-43fd-9da5-1ce4fce65b27 req-a04726bc-b495-4408-81d3-13f1c84f2d15 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:47.741556 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-38602ad5-7fa6-43fd-9da5-1ce4fce65b27 req-a04726bc-b495-4408-81d3-13f1c84f2d15 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:47.753244 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-38602ad5-7fa6-43fd-9da5-1ce4fce65b27 req-a04726bc-b495-4408-81d3-13f1c84f2d15 service nova] Creating event network-vif-plugged:46c407d4-a5b9-4ded-af69-53e4b90a70c8 for instance c5a9f9cd-86b0-4029-b3b3-c25470b8025d on hv-cinder-81809 Nov 16 16:07:47.757887 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-38602ad5-7fa6-43fd-9da5-1ce4fce65b27 req-a04726bc-b495-4408-81d3-13f1c84f2d15 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033113 Nov 16 16:07:47.758474 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 288/610] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:07:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:07:47.879928 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-5d97ca8d-8496-4111-9d28-7571dd44a69e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:47.880525 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-5d97ca8d-8496-4111-9d28-7571dd44a69e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:47.886400 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5d97ca8d-8496-4111-9d28-7571dd44a69e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:47.886840 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5d97ca8d-8496-4111-9d28-7571dd44a69e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:47.887649 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5d97ca8d-8496-4111-9d28-7571dd44a69e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:47.888082 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5d97ca8d-8496-4111-9d28-7571dd44a69e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:48.015044 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-5d97ca8d-8496-4111-9d28-7571dd44a69e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:48.022427 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-5d97ca8d-8496-4111-9d28-7571dd44a69e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1674 microversion: 2.1 time: 0.146963 Nov 16 16:07:48.022982 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 323/611] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:47 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1674 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:48.634071 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-1a25b903-2599-414f-ad94-0a1bf574a34f tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:48.634682 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-1a25b903-2599-414f-ad94-0a1bf574a34f tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:48.640633 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1a25b903-2599-414f-ad94-0a1bf574a34f tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:48.641072 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1a25b903-2599-414f-ad94-0a1bf574a34f tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:48.641845 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1a25b903-2599-414f-ad94-0a1bf574a34f tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:48.642779 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1a25b903-2599-414f-ad94-0a1bf574a34f tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:48.822835 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-1a25b903-2599-414f-ad94-0a1bf574a34f tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a73e3dbb5a4da5976643ad8224f56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ed7321198471eb4645081b697d234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:48.830723 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-1a25b903-2599-414f-ad94-0a1bf574a34f tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d" status: 200 len: 1358 microversion: 2.1 time: 0.200370 Nov 16 16:07:48.831707 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 289/612] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:48 2021] GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d => generated 1358 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:49.039596 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-4f5517a2-5826-4e83-bac7-ee412dbcf6ba tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:49.040221 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-4f5517a2-5826-4e83-bac7-ee412dbcf6ba tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:49.046442 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4f5517a2-5826-4e83-bac7-ee412dbcf6ba tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:49.046879 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4f5517a2-5826-4e83-bac7-ee412dbcf6ba tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:49.047672 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4f5517a2-5826-4e83-bac7-ee412dbcf6ba tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:49.048101 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4f5517a2-5826-4e83-bac7-ee412dbcf6ba tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:49.181383 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-4f5517a2-5826-4e83-bac7-ee412dbcf6ba tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:49.188609 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-4f5517a2-5826-4e83-bac7-ee412dbcf6ba tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1674 microversion: 2.1 time: 0.152621 Nov 16 16:07:49.189665 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 324/613] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:49 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:49.850016 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-ebafb4ee-99e5-4650-9187-a125d56d38b4 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:49.850568 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-ebafb4ee-99e5-4650-9187-a125d56d38b4 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:49.856761 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ebafb4ee-99e5-4650-9187-a125d56d38b4 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:49.857203 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ebafb4ee-99e5-4650-9187-a125d56d38b4 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:49.857970 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ebafb4ee-99e5-4650-9187-a125d56d38b4 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:49.858398 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ebafb4ee-99e5-4650-9187-a125d56d38b4 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:50.012545 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-ebafb4ee-99e5-4650-9187-a125d56d38b4 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a73e3dbb5a4da5976643ad8224f56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ed7321198471eb4645081b697d234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:50.019854 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-ebafb4ee-99e5-4650-9187-a125d56d38b4 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d" status: 200 len: 1358 microversion: 2.1 time: 0.174363 Nov 16 16:07:50.020638 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 290/614] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:49 2021] GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:50.207814 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d6d975ec-7b2c-4f2b-bf9e-4ff7934cd2b7 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:50.209003 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d6d975ec-7b2c-4f2b-bf9e-4ff7934cd2b7 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:50.215986 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d6d975ec-7b2c-4f2b-bf9e-4ff7934cd2b7 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:50.216816 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d6d975ec-7b2c-4f2b-bf9e-4ff7934cd2b7 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:50.217772 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d6d975ec-7b2c-4f2b-bf9e-4ff7934cd2b7 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:50.218209 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d6d975ec-7b2c-4f2b-bf9e-4ff7934cd2b7 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:50.358362 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d6d975ec-7b2c-4f2b-bf9e-4ff7934cd2b7 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:50.365755 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d6d975ec-7b2c-4f2b-bf9e-4ff7934cd2b7 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1674 microversion: 2.1 time: 0.162901 Nov 16 16:07:50.366325 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 325/615] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:50 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:51.036252 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-bf703775-069a-43c1-91fa-75b2ff16261d tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:51.036865 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-bf703775-069a-43c1-91fa-75b2ff16261d tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:51.043055 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bf703775-069a-43c1-91fa-75b2ff16261d tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:51.043549 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bf703775-069a-43c1-91fa-75b2ff16261d tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:51.044324 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bf703775-069a-43c1-91fa-75b2ff16261d tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:51.044760 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bf703775-069a-43c1-91fa-75b2ff16261d tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:51.179769 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-bf703775-069a-43c1-91fa-75b2ff16261d tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a73e3dbb5a4da5976643ad8224f56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ed7321198471eb4645081b697d234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:51.187036 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-bf703775-069a-43c1-91fa-75b2ff16261d tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d" status: 200 len: 1358 microversion: 2.1 time: 0.154614 Nov 16 16:07:51.187634 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 291/616] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:51 2021] GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:51.382435 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e122cb3b-c790-440b-8c72-a17472fb7d50 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:51.382945 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e122cb3b-c790-440b-8c72-a17472fb7d50 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:51.389320 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e122cb3b-c790-440b-8c72-a17472fb7d50 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:51.389763 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e122cb3b-c790-440b-8c72-a17472fb7d50 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:51.390531 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e122cb3b-c790-440b-8c72-a17472fb7d50 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:51.390963 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e122cb3b-c790-440b-8c72-a17472fb7d50 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:51.520191 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e122cb3b-c790-440b-8c72-a17472fb7d50 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:51.527713 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e122cb3b-c790-440b-8c72-a17472fb7d50 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1674 microversion: 2.1 time: 0.149015 Nov 16 16:07:51.528274 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 326/617] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:51 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1674 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:52.203657 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-696fd2a1-83ac-496a-a86a-b63bc89c97c2 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:52.204300 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-696fd2a1-83ac-496a-a86a-b63bc89c97c2 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:52.213418 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-696fd2a1-83ac-496a-a86a-b63bc89c97c2 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:52.214045 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-696fd2a1-83ac-496a-a86a-b63bc89c97c2 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:52.214825 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-696fd2a1-83ac-496a-a86a-b63bc89c97c2 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:52.215264 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-696fd2a1-83ac-496a-a86a-b63bc89c97c2 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:52.353486 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-696fd2a1-83ac-496a-a86a-b63bc89c97c2 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a73e3dbb5a4da5976643ad8224f56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ed7321198471eb4645081b697d234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:52.362242 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-696fd2a1-83ac-496a-a86a-b63bc89c97c2 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d" status: 200 len: 1549 microversion: 2.1 time: 0.161244 Nov 16 16:07:52.362677 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 292/618] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:52 2021] GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d => generated 1549 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:52.382646 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-767b8318-6061-4d7c-b3ac-ce738cf4014b tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:52.383254 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-767b8318-6061-4d7c-b3ac-ce738cf4014b tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:52.389304 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-767b8318-6061-4d7c-b3ac-ce738cf4014b tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:52.389967 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-767b8318-6061-4d7c-b3ac-ce738cf4014b tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:52.390739 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-767b8318-6061-4d7c-b3ac-ce738cf4014b tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:52.391171 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-767b8318-6061-4d7c-b3ac-ce738cf4014b tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:52.521555 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-767b8318-6061-4d7c-b3ac-ce738cf4014b tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a73e3dbb5a4da5976643ad8224f56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ed7321198471eb4645081b697d234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:52.529030 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-767b8318-6061-4d7c-b3ac-ce738cf4014b tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d" status: 200 len: 1549 microversion: 2.1 time: 0.152148 Nov 16 16:07:52.529593 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 327/619] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:52 2021] GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:52.544668 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-6f91e08f-ddb5-4974-8591-53793e4251d9 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:52.544924 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1a794570-2ef2-4178-9a90-7bc350035452 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:52.545523 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1a794570-2ef2-4178-9a90-7bc350035452 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:52.547940 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:07:52.547940 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Nov 16 16:07:52.548920 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-6f91e08f-ddb5-4974-8591-53793e4251d9 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2a73e3dbb5a4da5976643ad8224f56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ed7321198471eb4645081b697d234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:52.549657 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-6f91e08f-ddb5-4974-8591-53793e4251d9 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Searching by: {'deleted': False, 'project_id': 'e31ed7321198471eb4645081b697d234'} {{(pid=116085) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 16 16:07:52.552015 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1a794570-2ef2-4178-9a90-7bc350035452 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:52.552462 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1a794570-2ef2-4178-9a90-7bc350035452 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:52.553236 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1a794570-2ef2-4178-9a90-7bc350035452 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:52.553666 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1a794570-2ef2-4178-9a90-7bc350035452 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:52.556759 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6f91e08f-ddb5-4974-8591-53793e4251d9 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:52.557200 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6f91e08f-ddb5-4974-8591-53793e4251d9 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:52.558032 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6f91e08f-ddb5-4974-8591-53793e4251d9 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:52.558465 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6f91e08f-ddb5-4974-8591-53793e4251d9 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:52.650177 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.multi_cell_list [None req-6f91e08f-ddb5-4974-8591-53793e4251d9 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116085) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 16 16:07:52.686439 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1a794570-2ef2-4178-9a90-7bc350035452 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:52.694690 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1a794570-2ef2-4178-9a90-7bc350035452 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1674 microversion: 2.1 time: 0.153206 Nov 16 16:07:52.695356 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 328/620] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:52 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:07:52.751214 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-6f91e08f-ddb5-4974-8591-53793e4251d9 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.210059 Nov 16 16:07:52.751847 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 293/621] 10.222.0.46 () {58 vars in 1124 bytes} [Tue Nov 16 16:07:52 2021] GET /compute/v2.1/servers => generated 343 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:07:52.761798 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-cf74999b-97d1-47e9-aaa6-c11acd5a1d2e tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:52.762401 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-cf74999b-97d1-47e9-aaa6-c11acd5a1d2e tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:52.768318 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cf74999b-97d1-47e9-aaa6-c11acd5a1d2e tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:52.768832 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cf74999b-97d1-47e9-aaa6-c11acd5a1d2e tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:52.769720 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cf74999b-97d1-47e9-aaa6-c11acd5a1d2e tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:52.770152 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cf74999b-97d1-47e9-aaa6-c11acd5a1d2e tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:52.900380 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-cf74999b-97d1-47e9-aaa6-c11acd5a1d2e tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a73e3dbb5a4da5976643ad8224f56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ed7321198471eb4645081b697d234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:52.907983 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-cf74999b-97d1-47e9-aaa6-c11acd5a1d2e tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d" status: 200 len: 1549 microversion: 2.1 time: 0.149846 Nov 16 16:07:52.908545 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 329/622] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:52 2021] GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d => generated 1549 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:53.711134 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-f891ac30-b459-468d-92eb-3e14437f41c8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:53.711779 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-f891ac30-b459-468d-92eb-3e14437f41c8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:53.718150 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f891ac30-b459-468d-92eb-3e14437f41c8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:53.718600 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f891ac30-b459-468d-92eb-3e14437f41c8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:53.719375 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f891ac30-b459-468d-92eb-3e14437f41c8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:53.719838 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f891ac30-b459-468d-92eb-3e14437f41c8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:53.855905 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-f891ac30-b459-468d-92eb-3e14437f41c8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:53.863967 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-f891ac30-b459-468d-92eb-3e14437f41c8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1674 microversion: 2.1 time: 0.156413 Nov 16 16:07:53.864556 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 294/623] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:53 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:54.409041 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-71347afe-033f-4a9d-8662-174c9f5618f4 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c753700-76bd-4833-b34c-e3d82b0578e6"}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:07:54.410136 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-71347afe-033f-4a9d-8662-174c9f5618f4 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:54.416311 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-71347afe-033f-4a9d-8662-174c9f5618f4 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:54.416757 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-71347afe-033f-4a9d-8662-174c9f5618f4 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:54.417522 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-71347afe-033f-4a9d-8662-174c9f5618f4 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:54.417949 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-71347afe-033f-4a9d-8662-174c9f5618f4 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:54.650340 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-71347afe-033f-4a9d-8662-174c9f5618f4 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "POST /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.244733 Nov 16 16:07:54.651270 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 330/624] 10.222.0.46 () {60 vars in 1322 bytes} [Tue Nov 16 16:07:54 2021] POST /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d/os-volume_attachments => generated 194 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:07:54.880963 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-b31d579b-13c6-4752-848b-a7dad2965cf7 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:54.881706 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-b31d579b-13c6-4752-848b-a7dad2965cf7 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:54.887940 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b31d579b-13c6-4752-848b-a7dad2965cf7 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:54.888392 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b31d579b-13c6-4752-848b-a7dad2965cf7 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:54.889171 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b31d579b-13c6-4752-848b-a7dad2965cf7 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:54.889684 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b31d579b-13c6-4752-848b-a7dad2965cf7 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:55.028192 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-b31d579b-13c6-4752-848b-a7dad2965cf7 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:55.036199 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-b31d579b-13c6-4752-848b-a7dad2965cf7 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1674 microversion: 2.1 time: 0.158833 Nov 16 16:07:55.036769 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 295/625] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:54 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:56.053913 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-8ef5bbd5-b5a4-4a00-8d34-5ea8bd3dad6c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:56.054620 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-8ef5bbd5-b5a4-4a00-8d34-5ea8bd3dad6c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:56.061373 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8ef5bbd5-b5a4-4a00-8d34-5ea8bd3dad6c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:56.061828 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8ef5bbd5-b5a4-4a00-8d34-5ea8bd3dad6c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:56.062648 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8ef5bbd5-b5a4-4a00-8d34-5ea8bd3dad6c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:56.066847 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8ef5bbd5-b5a4-4a00-8d34-5ea8bd3dad6c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:56.203447 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-8ef5bbd5-b5a4-4a00-8d34-5ea8bd3dad6c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:56.212588 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-8ef5bbd5-b5a4-4a00-8d34-5ea8bd3dad6c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1674 microversion: 2.1 time: 0.163368 Nov 16 16:07:56.213245 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 331/626] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:56 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:57.229324 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-f0352e0b-d9da-46b9-8efb-974f462bdcda tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:57.229926 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-f0352e0b-d9da-46b9-8efb-974f462bdcda tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:57.236108 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f0352e0b-d9da-46b9-8efb-974f462bdcda tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:57.236552 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f0352e0b-d9da-46b9-8efb-974f462bdcda tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:57.237325 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f0352e0b-d9da-46b9-8efb-974f462bdcda tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:57.238404 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f0352e0b-d9da-46b9-8efb-974f462bdcda tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:57.308471 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-74997995-a6a5-4d95-879a-8a344e40bc4d tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:57.308995 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-74997995-a6a5-4d95-879a-8a344e40bc4d tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] [instance: be30cc01-fa20-42f1-80d2-a8becb9a7e2f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:57.315108 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-74997995-a6a5-4d95-879a-8a344e40bc4d tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:57.315589 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-74997995-a6a5-4d95-879a-8a344e40bc4d tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:57.317066 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-74997995-a6a5-4d95-879a-8a344e40bc4d tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:57.317494 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-74997995-a6a5-4d95-879a-8a344e40bc4d tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:57.374697 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-f0352e0b-d9da-46b9-8efb-974f462bdcda tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:57.382193 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-f0352e0b-d9da-46b9-8efb-974f462bdcda tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1674 microversion: 2.1 time: 0.156463 Nov 16 16:07:57.382957 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 296/627] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:57 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:57.404091 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.objects.instance [None req-74997995-a6a5-4d95-879a-8a344e40bc4d tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lazy-loading 'services' on Instance uuid be30cc01-fa20-42f1-80d2-a8becb9a7e2f {{(pid=116084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:07:57.474134 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-74997995-a6a5-4d95-879a-8a344e40bc4d tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] 10.222.0.46 "DELETE /compute/v2.1/servers/be30cc01-fa20-42f1-80d2-a8becb9a7e2f/os-volume_attachments/aea38eba-c84b-4b14-937e-ef95ab8bc563" status: 202 len: 0 microversion: 2.1 time: 0.169497 Nov 16 16:07:57.474791 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 332/628] 10.222.0.46 () {58 vars in 1415 bytes} [Tue Nov 16 16:07:57 2021] DELETE /compute/v2.1/servers/be30cc01-fa20-42f1-80d2-a8becb9a7e2f/os-volume_attachments/aea38eba-c84b-4b14-937e-ef95ab8bc563 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:07:58.400296 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-c3e1534a-ae10-480d-976f-40e1344bcb8c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:58.400935 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-c3e1534a-ae10-480d-976f-40e1344bcb8c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:58.407484 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c3e1534a-ae10-480d-976f-40e1344bcb8c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:58.407945 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c3e1534a-ae10-480d-976f-40e1344bcb8c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:58.408717 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c3e1534a-ae10-480d-976f-40e1344bcb8c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:58.409187 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c3e1534a-ae10-480d-976f-40e1344bcb8c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:58.548185 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-c3e1534a-ae10-480d-976f-40e1344bcb8c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:58.556244 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-c3e1534a-ae10-480d-976f-40e1344bcb8c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1674 microversion: 2.1 time: 0.160545 Nov 16 16:07:58.556903 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 297/629] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:58 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:59.575051 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b0dee928-7b89-4209-a343-6d416d4eea06 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:59.576614 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b0dee928-7b89-4209-a343-6d416d4eea06 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:59.583763 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b0dee928-7b89-4209-a343-6d416d4eea06 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:59.584444 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b0dee928-7b89-4209-a343-6d416d4eea06 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:59.585473 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b0dee928-7b89-4209-a343-6d416d4eea06 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:59.585992 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b0dee928-7b89-4209-a343-6d416d4eea06 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:59.831670 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b0dee928-7b89-4209-a343-6d416d4eea06 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:07:59.839713 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b0dee928-7b89-4209-a343-6d416d4eea06 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1651 microversion: 2.1 time: 0.269473 Nov 16 16:07:59.840296 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 333/630] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:59 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1651 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:07:59.855675 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-6feef870-5c4c-47bc-9ac7-10e309e4fab0 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:07:59.862114 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6feef870-5c4c-47bc-9ac7-10e309e4fab0 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:59.862561 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6feef870-5c4c-47bc-9ac7-10e309e4fab0 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:59.886044 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-6feef870-5c4c-47bc-9ac7-10e309e4fab0 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Going to try to start instance {{(pid=116085) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 16 16:07:59.928517 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-6feef870-5c4c-47bc-9ac7-10e309e4fab0 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action" status: 202 len: 0 microversion: 2.1 time: 0.076415 Nov 16 16:07:59.929162 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 298/631] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:07:59 2021] POST /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:07:59.938215 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-bf979eb3-7757-4d04-942c-9fe1b8595915 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:07:59.938765 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-bf979eb3-7757-4d04-942c-9fe1b8595915 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:07:59.952250 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bf979eb3-7757-4d04-942c-9fe1b8595915 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:59.956951 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bf979eb3-7757-4d04-942c-9fe1b8595915 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:07:59.958346 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bf979eb3-7757-4d04-942c-9fe1b8595915 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:07:59.959581 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bf979eb3-7757-4d04-942c-9fe1b8595915 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:00.405134 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-bf979eb3-7757-4d04-942c-9fe1b8595915 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:00.415408 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-bf979eb3-7757-4d04-942c-9fe1b8595915 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1660 microversion: 2.1 time: 0.481410 Nov 16 16:08:00.416031 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 334/632] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:07:59 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1660 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:08:01.433149 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-0d2f2132-2cad-4392-bcf6-5817b510c741 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:01.433761 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-0d2f2132-2cad-4392-bcf6-5817b510c741 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:01.439840 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0d2f2132-2cad-4392-bcf6-5817b510c741 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:01.440286 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0d2f2132-2cad-4392-bcf6-5817b510c741 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:01.441051 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0d2f2132-2cad-4392-bcf6-5817b510c741 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:01.441685 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0d2f2132-2cad-4392-bcf6-5817b510c741 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:01.573561 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-0d2f2132-2cad-4392-bcf6-5817b510c741 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:01.580884 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-0d2f2132-2cad-4392-bcf6-5817b510c741 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1664 microversion: 2.1 time: 0.152308 Nov 16 16:08:01.581504 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 299/633] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:01 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1664 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:08:02.202477 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-18c3c123-dac4-4431-9c8d-cfe622d03dda tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:02.203084 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-18c3c123-dac4-4431-9c8d-cfe622d03dda tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:02.210361 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-18c3c123-dac4-4431-9c8d-cfe622d03dda tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:02.210800 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-18c3c123-dac4-4431-9c8d-cfe622d03dda tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:02.211596 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-18c3c123-dac4-4431-9c8d-cfe622d03dda tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:02.212028 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-18c3c123-dac4-4431-9c8d-cfe622d03dda tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:02.343199 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-18c3c123-dac4-4431-9c8d-cfe622d03dda tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a73e3dbb5a4da5976643ad8224f56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ed7321198471eb4645081b697d234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:02.351944 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-18c3c123-dac4-4431-9c8d-cfe622d03dda tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d" status: 200 len: 1595 microversion: 2.1 time: 0.152999 Nov 16 16:08:02.352514 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 335/634] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:02 2021] GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d => generated 1595 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:08:02.816210 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-74799b98-ba8b-407f-ae55-5b7ddd2901cf tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:02.816713 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-74799b98-ba8b-407f-ae55-5b7ddd2901cf tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] [instance: be30cc01-fa20-42f1-80d2-a8becb9a7e2f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:02.823732 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-74799b98-ba8b-407f-ae55-5b7ddd2901cf tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:02.824181 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-74799b98-ba8b-407f-ae55-5b7ddd2901cf tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:02.824962 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-74799b98-ba8b-407f-ae55-5b7ddd2901cf tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:02.825394 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-74799b98-ba8b-407f-ae55-5b7ddd2901cf tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:02.850189 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-74799b98-ba8b-407f-ae55-5b7ddd2901cf tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] [instance: be30cc01-fa20-42f1-80d2-a8becb9a7e2f] Going to try to terminate instance {{(pid=116085) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 16:08:02.927143 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-74799b98-ba8b-407f-ae55-5b7ddd2901cf tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] 10.222.0.46 "DELETE /compute/v2.1/servers/be30cc01-fa20-42f1-80d2-a8becb9a7e2f" status: 204 len: 0 microversion: 2.1 time: 0.113700 Nov 16 16:08:02.928317 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 300/635] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 16 16:08:02 2021] DELETE /compute/v2.1/servers/be30cc01-fa20-42f1-80d2-a8becb9a7e2f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 16:08:02.936847 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-84a43db8-b10c-4f78-a2d3-995b2202ca49 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:02.937809 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-84a43db8-b10c-4f78-a2d3-995b2202ca49 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] [instance: be30cc01-fa20-42f1-80d2-a8becb9a7e2f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:02.944529 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-84a43db8-b10c-4f78-a2d3-995b2202ca49 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:02.945051 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-84a43db8-b10c-4f78-a2d3-995b2202ca49 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:02.945941 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-84a43db8-b10c-4f78-a2d3-995b2202ca49 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:02.946444 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-84a43db8-b10c-4f78-a2d3-995b2202ca49 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:03.229804 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-84a43db8-b10c-4f78-a2d3-995b2202ca49 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fcb8d8c3d490e915fe9583f70cb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bf6ebc44c444e911ba343e1c14785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:03.237673 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-84a43db8-b10c-4f78-a2d3-995b2202ca49 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] 10.222.0.46 "GET /compute/v2.1/servers/be30cc01-fa20-42f1-80d2-a8becb9a7e2f" status: 200 len: 1513 microversion: 2.1 time: 0.305050 Nov 16 16:08:03.238435 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 336/636] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:02 2021] GET /compute/v2.1/servers/be30cc01-fa20-42f1-80d2-a8becb9a7e2f => generated 1513 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:08:04.152612 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-6363fbb8-6a94-424a-97d6-b27d45b0c9b1 req-5f6b3a57-ff2e-4a06-bdd1-2ee2ebe2230e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5a9f9cd-86b0-4029-b3b3-c25470b8025d", "tag": "46c407d4-a5b9-4ded-af69-53e4b90a70c8"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:04.155573 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:08:04.155573 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Nov 16 16:08:04.163794 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-6363fbb8-6a94-424a-97d6-b27d45b0c9b1 req-5f6b3a57-ff2e-4a06-bdd1-2ee2ebe2230e service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:04.164234 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-6363fbb8-6a94-424a-97d6-b27d45b0c9b1 req-5f6b3a57-ff2e-4a06-bdd1-2ee2ebe2230e service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:04.175933 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-6363fbb8-6a94-424a-97d6-b27d45b0c9b1 req-5f6b3a57-ff2e-4a06-bdd1-2ee2ebe2230e service nova] Creating event network-changed:46c407d4-a5b9-4ded-af69-53e4b90a70c8 for instance c5a9f9cd-86b0-4029-b3b3-c25470b8025d on hv-cinder-81809 Nov 16 16:08:04.185366 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-6363fbb8-6a94-424a-97d6-b27d45b0c9b1 req-5f6b3a57-ff2e-4a06-bdd1-2ee2ebe2230e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036886 Nov 16 16:08:04.186343 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 301/637] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:08:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:08:04.256747 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3a8a7089-a1ab-48a4-a16a-3765ba848da7 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:04.257424 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-3a8a7089-a1ab-48a4-a16a-3765ba848da7 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] [instance: be30cc01-fa20-42f1-80d2-a8becb9a7e2f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:04.265706 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3a8a7089-a1ab-48a4-a16a-3765ba848da7 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:04.266301 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3a8a7089-a1ab-48a4-a16a-3765ba848da7 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:04.267151 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3a8a7089-a1ab-48a4-a16a-3765ba848da7 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:04.267683 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3a8a7089-a1ab-48a4-a16a-3765ba848da7 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:04.498820 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-3a8a7089-a1ab-48a4-a16a-3765ba848da7 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fcb8d8c3d490e915fe9583f70cb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bf6ebc44c444e911ba343e1c14785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:04.513113 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-3a8a7089-a1ab-48a4-a16a-3765ba848da7 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] 10.222.0.46 "GET /compute/v2.1/servers/be30cc01-fa20-42f1-80d2-a8becb9a7e2f" status: 200 len: 1513 microversion: 2.1 time: 0.261095 Nov 16 16:08:04.514414 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 337/638] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:04 2021] GET /compute/v2.1/servers/be30cc01-fa20-42f1-80d2-a8becb9a7e2f => generated 1513 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:08:05.383164 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-b75bbc9d-bf43-4710-86f1-09fc892ce7f0 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-999167629"}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:05.384149 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-b75bbc9d-bf43-4710-86f1-09fc892ce7f0 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:05.391090 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b75bbc9d-bf43-4710-86f1-09fc892ce7f0 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:05.391569 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b75bbc9d-bf43-4710-86f1-09fc892ce7f0 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:05.392350 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b75bbc9d-bf43-4710-86f1-09fc892ce7f0 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:05.392782 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b75bbc9d-bf43-4710-86f1-09fc892ce7f0 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:05.531383 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-78a8130c-8270-401a-81a5-b07a3dd803cd tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:05.532646 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-78a8130c-8270-401a-81a5-b07a3dd803cd tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] [instance: be30cc01-fa20-42f1-80d2-a8becb9a7e2f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:05.535626 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.network.security_group_api [None req-b75bbc9d-bf43-4710-86f1-09fc892ce7f0 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Adding security group 214fc19b-118a-46ba-843f-b8d426e798fc to port 46c407d4-a5b9-4ded-af69-53e4b90a70c8 Nov 16 16:08:05.539273 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-78a8130c-8270-401a-81a5-b07a3dd803cd tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:05.539755 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-78a8130c-8270-401a-81a5-b07a3dd803cd tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:05.540572 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-78a8130c-8270-401a-81a5-b07a3dd803cd tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:05.541017 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-78a8130c-8270-401a-81a5-b07a3dd803cd tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:05.571779 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-78a8130c-8270-401a-81a5-b07a3dd803cd tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:05.572230 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-78a8130c-8270-401a-81a5-b07a3dd803cd tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:05.572692 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.objects.instance [None req-78a8130c-8270-401a-81a5-b07a3dd803cd tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lazy-loading 'fault' on Instance uuid be30cc01-fa20-42f1-80d2-a8becb9a7e2f {{(pid=116084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:08:05.631374 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-78a8130c-8270-401a-81a5-b07a3dd803cd tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fcb8d8c3d490e915fe9583f70cb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bf6ebc44c444e911ba343e1c14785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:05.638897 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-78a8130c-8270-401a-81a5-b07a3dd803cd tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] 10.222.0.46 "GET /compute/v2.1/servers/be30cc01-fa20-42f1-80d2-a8becb9a7e2f" status: 200 len: 1308 microversion: 2.1 time: 0.111149 Nov 16 16:08:05.639482 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 338/639] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:05 2021] GET /compute/v2.1/servers/be30cc01-fa20-42f1-80d2-a8becb9a7e2f => generated 1308 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:08:05.918185 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-b75bbc9d-bf43-4710-86f1-09fc892ce7f0 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "POST /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d/action" status: 202 len: 0 microversion: 2.1 time: 0.540889 Nov 16 16:08:05.918960 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 302/640] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:08:05 2021] POST /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d/action => generated 0 bytes in 543 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:08:05.927344 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-4b47fc11-7410-49ee-a39c-f4d897d3a789 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:05.929100 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-4b47fc11-7410-49ee-a39c-f4d897d3a789 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:05.935760 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4b47fc11-7410-49ee-a39c-f4d897d3a789 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:05.936201 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4b47fc11-7410-49ee-a39c-f4d897d3a789 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:05.937223 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4b47fc11-7410-49ee-a39c-f4d897d3a789 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:05.937871 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4b47fc11-7410-49ee-a39c-f4d897d3a789 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:06.108352 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-4b47fc11-7410-49ee-a39c-f4d897d3a789 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a73e3dbb5a4da5976643ad8224f56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ed7321198471eb4645081b697d234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:06.117487 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-4b47fc11-7410-49ee-a39c-f4d897d3a789 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d" status: 200 len: 1759 microversion: 2.1 time: 0.194265 Nov 16 16:08:06.118266 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 339/641] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:05 2021] GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d => generated 1759 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:08:06.200554 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-74c16991-abbb-4b96-b6d4-32905a2c9ba6 req-a4b63829-d6e6-4834-93bd-615b0ce52269 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be30cc01-fa20-42f1-80d2-a8becb9a7e2f", "name": "network-vif-deleted", "tag": "91aaaca5-262f-4d80-a2a1-1efde793c011"}, {"name": "network-changed", "server_uuid": "c5a9f9cd-86b0-4029-b3b3-c25470b8025d", "tag": "46c407d4-a5b9-4ded-af69-53e4b90a70c8"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:06.202632 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:08:06.202632 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Nov 16 16:08:06.211334 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-74c16991-abbb-4b96-b6d4-32905a2c9ba6 req-a4b63829-d6e6-4834-93bd-615b0ce52269 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:06.211810 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-74c16991-abbb-4b96-b6d4-32905a2c9ba6 req-a4b63829-d6e6-4834-93bd-615b0ce52269 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:06.226761 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-74c16991-abbb-4b96-b6d4-32905a2c9ba6 req-a4b63829-d6e6-4834-93bd-615b0ce52269 service nova] Creating event network-vif-deleted:91aaaca5-262f-4d80-a2a1-1efde793c011 for instance be30cc01-fa20-42f1-80d2-a8becb9a7e2f on hv-cinder-81809 Nov 16 16:08:06.227264 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-74c16991-abbb-4b96-b6d4-32905a2c9ba6 req-a4b63829-d6e6-4834-93bd-615b0ce52269 service nova] Creating event network-changed:46c407d4-a5b9-4ded-af69-53e4b90a70c8 for instance c5a9f9cd-86b0-4029-b3b3-c25470b8025d on hv-cinder-81809 Nov 16 16:08:06.233479 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-74c16991-abbb-4b96-b6d4-32905a2c9ba6 req-a4b63829-d6e6-4834-93bd-615b0ce52269 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.036500 Nov 16 16:08:06.234490 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 303/642] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:08:06 2021] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:08:06.656788 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-bf88f232-ccd2-45c7-95f2-a04a342b7c33 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:06.658024 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-bf88f232-ccd2-45c7-95f2-a04a342b7c33 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] [instance: be30cc01-fa20-42f1-80d2-a8becb9a7e2f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:06.665984 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bf88f232-ccd2-45c7-95f2-a04a342b7c33 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:06.666579 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bf88f232-ccd2-45c7-95f2-a04a342b7c33 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:06.668292 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bf88f232-ccd2-45c7-95f2-a04a342b7c33 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:06.668963 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bf88f232-ccd2-45c7-95f2-a04a342b7c33 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:06.682862 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-bf88f232-ccd2-45c7-95f2-a04a342b7c33 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] HTTP exception thrown: Instance be30cc01-fa20-42f1-80d2-a8becb9a7e2f could not be found. Nov 16 16:08:06.683454 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-bf88f232-ccd2-45c7-95f2-a04a342b7c33 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Returning 404 to user: Instance be30cc01-fa20-42f1-80d2-a8becb9a7e2f could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:08:06.684319 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-bf88f232-ccd2-45c7-95f2-a04a342b7c33 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] 10.222.0.46 "GET /compute/v2.1/servers/be30cc01-fa20-42f1-80d2-a8becb9a7e2f" status: 404 len: 111 microversion: 2.1 time: 0.031157 Nov 16 16:08:06.684875 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 340/643] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:06 2021] GET /compute/v2.1/servers/be30cc01-fa20-42f1-80d2-a8becb9a7e2f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:08:06.742082 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-bba79d62-544e-4166-8384-6d22f299c7bb tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:06.742662 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-bba79d62-544e-4166-8384-6d22f299c7bb tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:06.748878 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bba79d62-544e-4166-8384-6d22f299c7bb tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:06.749327 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bba79d62-544e-4166-8384-6d22f299c7bb tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:06.750112 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bba79d62-544e-4166-8384-6d22f299c7bb tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:06.750547 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bba79d62-544e-4166-8384-6d22f299c7bb tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:06.791105 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-bba79d62-544e-4166-8384-6d22f299c7bb tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/os-volume_attachments/23762958-d3d4-4e9a-a9b9-484e15f2ce97" status: 200 len: 194 microversion: 2.20 time: 0.053516 Nov 16 16:08:06.791756 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 304/644] 10.222.0.46 () {60 vars in 1453 bytes} [Tue Nov 16 16:08:06 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/os-volume_attachments/23762958-d3d4-4e9a-a9b9-484e15f2ce97 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:08:06.858485 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-25d98849-6661-4e76-a0a6-86da96daeb7c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:06.858840 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-25d98849-6661-4e76-a0a6-86da96daeb7c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:06.864755 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-25d98849-6661-4e76-a0a6-86da96daeb7c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:06.865203 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-25d98849-6661-4e76-a0a6-86da96daeb7c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:06.865996 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-25d98849-6661-4e76-a0a6-86da96daeb7c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:06.866575 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-25d98849-6661-4e76-a0a6-86da96daeb7c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:06.946120 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.objects.instance [None req-25d98849-6661-4e76-a0a6-86da96daeb7c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lazy-loading 'services' on Instance uuid 6447972e-6291-4e68-8271-c93523206230 {{(pid=116084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:08:07.014680 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-25d98849-6661-4e76-a0a6-86da96daeb7c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/os-volume_attachments/23762958-d3d4-4e9a-a9b9-484e15f2ce97" status: 202 len: 0 microversion: 2.20 time: 0.160136 Nov 16 16:08:07.015257 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 341/645] 10.222.0.46 () {60 vars in 1456 bytes} [Tue Nov 16 16:08:06 2021] DELETE /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/os-volume_attachments/23762958-d3d4-4e9a-a9b9-484e15f2ce97 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 16 16:08:07.024434 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-b12c563b-fd6e-4f2f-865b-b56138519c12 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:07.025332 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-b12c563b-fd6e-4f2f-865b-b56138519c12 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:07.031396 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b12c563b-fd6e-4f2f-865b-b56138519c12 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:07.031866 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b12c563b-fd6e-4f2f-865b-b56138519c12 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:07.032630 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b12c563b-fd6e-4f2f-865b-b56138519c12 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:07.033054 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b12c563b-fd6e-4f2f-865b-b56138519c12 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:07.062596 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-b12c563b-fd6e-4f2f-865b-b56138519c12 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042922 Nov 16 16:08:07.063148 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 305/646] 10.222.0.46 () {60 vars in 1342 bytes} [Tue Nov 16 16:08:07 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:08:08.074420 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-748b1678-ce76-4f1b-940c-8371e8560af5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:08.075447 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-748b1678-ce76-4f1b-940c-8371e8560af5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:08.081530 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-748b1678-ce76-4f1b-940c-8371e8560af5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:08.081972 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-748b1678-ce76-4f1b-940c-8371e8560af5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:08.083320 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-748b1678-ce76-4f1b-940c-8371e8560af5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:08.083786 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-748b1678-ce76-4f1b-940c-8371e8560af5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:08.112525 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-748b1678-ce76-4f1b-940c-8371e8560af5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042696 Nov 16 16:08:08.113056 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 342/647] 10.222.0.46 () {60 vars in 1342 bytes} [Tue Nov 16 16:08:08 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:08:09.124683 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-a134497e-a696-4b7d-91bd-b71a11cb070f tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:09.125587 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-a134497e-a696-4b7d-91bd-b71a11cb070f tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:09.132650 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a134497e-a696-4b7d-91bd-b71a11cb070f tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:09.133094 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a134497e-a696-4b7d-91bd-b71a11cb070f tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:09.133863 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a134497e-a696-4b7d-91bd-b71a11cb070f tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:09.134296 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a134497e-a696-4b7d-91bd-b71a11cb070f tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:09.163096 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-a134497e-a696-4b7d-91bd-b71a11cb070f tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042176 Nov 16 16:08:09.163713 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 306/648] 10.222.0.46 () {60 vars in 1342 bytes} [Tue Nov 16 16:08:09 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:08:10.174119 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-75fe59dd-bbe1-4987-9868-7c627737e231 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:10.175026 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-75fe59dd-bbe1-4987-9868-7c627737e231 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:10.181483 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-75fe59dd-bbe1-4987-9868-7c627737e231 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:10.181934 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-75fe59dd-bbe1-4987-9868-7c627737e231 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:10.182712 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-75fe59dd-bbe1-4987-9868-7c627737e231 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:10.183154 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-75fe59dd-bbe1-4987-9868-7c627737e231 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:10.215032 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-75fe59dd-bbe1-4987-9868-7c627737e231 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044556 Nov 16 16:08:10.215622 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 343/649] 10.222.0.46 () {60 vars in 1342 bytes} [Tue Nov 16 16:08:10 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:08:11.227006 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-7e76c424-3b2b-4544-a7c6-7ca1228aa84e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:11.228112 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-7e76c424-3b2b-4544-a7c6-7ca1228aa84e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:11.235218 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7e76c424-3b2b-4544-a7c6-7ca1228aa84e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:11.235705 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7e76c424-3b2b-4544-a7c6-7ca1228aa84e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:11.236490 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7e76c424-3b2b-4544-a7c6-7ca1228aa84e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:11.236932 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7e76c424-3b2b-4544-a7c6-7ca1228aa84e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:11.266267 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-7e76c424-3b2b-4544-a7c6-7ca1228aa84e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043624 Nov 16 16:08:11.267019 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 307/650] 10.222.0.46 () {60 vars in 1342 bytes} [Tue Nov 16 16:08:11 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:08:11.328122 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1aa6828a-bb31-40c4-9107-0bc3e5895b5a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:11.328672 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1aa6828a-bb31-40c4-9107-0bc3e5895b5a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:11.335646 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1aa6828a-bb31-40c4-9107-0bc3e5895b5a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:11.336198 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1aa6828a-bb31-40c4-9107-0bc3e5895b5a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:11.336984 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1aa6828a-bb31-40c4-9107-0bc3e5895b5a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:11.337419 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1aa6828a-bb31-40c4-9107-0bc3e5895b5a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:11.362191 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1aa6828a-bb31-40c4-9107-0bc3e5895b5a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Going to try to terminate instance {{(pid=116084) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 16:08:11.435545 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1aa6828a-bb31-40c4-9107-0bc3e5895b5a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 204 len: 0 microversion: 2.20 time: 0.110599 Nov 16 16:08:11.436109 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 344/651] 10.222.0.46 () {60 vars in 1279 bytes} [Tue Nov 16 16:08:11 2021] DELETE /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 16 16:08:11.444784 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-8bfa983b-57ff-4e89-98a7-b36c95c6594f tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:11.445386 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-8bfa983b-57ff-4e89-98a7-b36c95c6594f tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:11.451240 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8bfa983b-57ff-4e89-98a7-b36c95c6594f tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:11.451712 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8bfa983b-57ff-4e89-98a7-b36c95c6594f tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:11.452478 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8bfa983b-57ff-4e89-98a7-b36c95c6594f tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:11.452912 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8bfa983b-57ff-4e89-98a7-b36c95c6594f tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:11.596299 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-8bfa983b-57ff-4e89-98a7-b36c95c6594f tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:11.604895 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-8bfa983b-57ff-4e89-98a7-b36c95c6594f tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:11.606350 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-8bfa983b-57ff-4e89-98a7-b36c95c6594f tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:11.607502 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-8bfa983b-57ff-4e89-98a7-b36c95c6594f tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1723 microversion: 2.20 time: 0.166960 Nov 16 16:08:11.608091 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 308/652] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:08:11 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:08:12.626741 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b3e764a4-21d6-43ae-9294-bea80cb352bf tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:12.627352 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b3e764a4-21d6-43ae-9294-bea80cb352bf tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:12.633608 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b3e764a4-21d6-43ae-9294-bea80cb352bf tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:12.634056 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b3e764a4-21d6-43ae-9294-bea80cb352bf tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:12.634826 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b3e764a4-21d6-43ae-9294-bea80cb352bf tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:12.635260 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b3e764a4-21d6-43ae-9294-bea80cb352bf tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:12.773099 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b3e764a4-21d6-43ae-9294-bea80cb352bf tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:12.781539 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b3e764a4-21d6-43ae-9294-bea80cb352bf tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:12.783007 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b3e764a4-21d6-43ae-9294-bea80cb352bf tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:12.784289 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b3e764a4-21d6-43ae-9294-bea80cb352bf tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1723 microversion: 2.20 time: 0.161761 Nov 16 16:08:12.787070 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 345/653] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:08:12 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:08:13.805566 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-8d2537fe-b0f7-4438-83d3-abe2e9c40f97 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:13.806153 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-8d2537fe-b0f7-4438-83d3-abe2e9c40f97 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:13.812355 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8d2537fe-b0f7-4438-83d3-abe2e9c40f97 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:13.812792 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8d2537fe-b0f7-4438-83d3-abe2e9c40f97 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:13.813551 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8d2537fe-b0f7-4438-83d3-abe2e9c40f97 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:13.813974 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8d2537fe-b0f7-4438-83d3-abe2e9c40f97 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:13.949079 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-8d2537fe-b0f7-4438-83d3-abe2e9c40f97 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:13.956776 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-8d2537fe-b0f7-4438-83d3-abe2e9c40f97 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:13.958566 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-8d2537fe-b0f7-4438-83d3-abe2e9c40f97 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:13.959749 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-8d2537fe-b0f7-4438-83d3-abe2e9c40f97 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1723 microversion: 2.20 time: 0.159060 Nov 16 16:08:13.960315 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 309/654] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:08:13 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:08:14.490944 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d6884fdc-2c66-40df-a7c3-71a9035a695b tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1675745463", "imageRef": "7c3bd8e0-8d7e-4cf7-90db-742c4f55e405", "flavorRef": "452", "networks": [{"uuid": "db4f0bf1-384b-4186-b414-f554b98403a2"}]}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:14.543372 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.network.neutron [None req-d6884fdc-2c66-40df-a7c3-71a9035a695b tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] validate_networks() for [('db4f0bf1-384b-4186-b414-f554b98403a2', None, None, None, None, None)] {{(pid=116084) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 16:08:14.977677 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-35501844-cc27-4a9e-93bf-b649aade080a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:14.978328 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-35501844-cc27-4a9e-93bf-b649aade080a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:14.984851 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-35501844-cc27-4a9e-93bf-b649aade080a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:14.985294 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-35501844-cc27-4a9e-93bf-b649aade080a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:14.986082 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-35501844-cc27-4a9e-93bf-b649aade080a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:14.986513 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-35501844-cc27-4a9e-93bf-b649aade080a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:15.330438 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-d6884fdc-2c66-40df-a7c3-71a9035a695b tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Flavor limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 16:08:15.330966 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-d6884fdc-2c66-40df-a7c3-71a9035a695b tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Image limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 16:08:15.331534 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-d6884fdc-2c66-40df-a7c3-71a9035a695b tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Flavor pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 16:08:15.332074 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-d6884fdc-2c66-40df-a7c3-71a9035a695b tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Image pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 16:08:15.332521 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-d6884fdc-2c66-40df-a7c3-71a9035a695b tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 16:08:15.341323 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d6884fdc-2c66-40df-a7c3-71a9035a695b tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:15.341768 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d6884fdc-2c66-40df-a7c3-71a9035a695b tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:15.342567 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d6884fdc-2c66-40df-a7c3-71a9035a695b tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:15.343004 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d6884fdc-2c66-40df-a7c3-71a9035a695b tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:15.359625 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-d6884fdc-2c66-40df-a7c3-71a9035a695b tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Getting quotas for project 218bf6ebc44c444e911ba343e1c14785. Resources: {'instances', 'ram', 'cores'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:08:15.363663 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-d6884fdc-2c66-40df-a7c3-71a9035a695b tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Getting quotas for user 5c4fcb8d8c3d490e915fe9583f70cb2b and project 218bf6ebc44c444e911ba343e1c14785. Resources: {'instances', 'ram', 'cores'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:08:15.375182 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d6884fdc-2c66-40df-a7c3-71a9035a695b tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Going to run 1 instances... {{(pid=116084) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 16:08:15.377580 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d6884fdc-2c66-40df-a7c3-71a9035a695b tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] [instance: 8be6d15b-4901-4b1b-9d39-97378569d908] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c3bd8e0-8d7e-4cf7-90db-742c4f55e405',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116084) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 16:08:15.424736 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d6884fdc-2c66-40df-a7c3-71a9035a695b tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.937396 Nov 16 16:08:15.425615 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 346/655] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 16 16:08:14 2021] POST /compute/v2.1/servers => generated 380 bytes in 939 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 16 16:08:15.435697 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-08e5ea55-7862-45dd-a91b-86ed275c854a tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:15.436307 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-08e5ea55-7862-45dd-a91b-86ed275c854a tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] [instance: 8be6d15b-4901-4b1b-9d39-97378569d908] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:15.513952 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-35501844-cc27-4a9e-93bf-b649aade080a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:15.522997 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-35501844-cc27-4a9e-93bf-b649aade080a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:15.524646 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-35501844-cc27-4a9e-93bf-b649aade080a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:15.525964 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-35501844-cc27-4a9e-93bf-b649aade080a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1723 microversion: 2.20 time: 0.552293 Nov 16 16:08:15.526786 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 310/656] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:08:14 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1723 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:08:15.535750 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-08e5ea55-7862-45dd-a91b-86ed275c854a tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fcb8d8c3d490e915fe9583f70cb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bf6ebc44c444e911ba343e1c14785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:15.544945 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-08e5ea55-7862-45dd-a91b-86ed275c854a tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] 10.222.0.46 "GET /compute/v2.1/servers/8be6d15b-4901-4b1b-9d39-97378569d908" status: 200 len: 1219 microversion: 2.1 time: 0.112688 Nov 16 16:08:15.545762 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 347/657] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:15 2021] GET /compute/v2.1/servers/8be6d15b-4901-4b1b-9d39-97378569d908 => generated 1219 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:08:16.070377 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-7bd6fe6b-2e53-4f06-9e24-8f00b8606724 req-6a9e3837-fe9f-4301-a7ed-f3dffcaf1a6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6447972e-6291-4e68-8271-c93523206230", "name": "network-vif-deleted", "tag": "68ede3d7-0ef4-42a4-b3de-ef6046161db6"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:16.071996 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:08:16.071996 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Nov 16 16:08:16.079626 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-7bd6fe6b-2e53-4f06-9e24-8f00b8606724 req-6a9e3837-fe9f-4301-a7ed-f3dffcaf1a6e service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:16.080068 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-7bd6fe6b-2e53-4f06-9e24-8f00b8606724 req-6a9e3837-fe9f-4301-a7ed-f3dffcaf1a6e service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:16.091843 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-7bd6fe6b-2e53-4f06-9e24-8f00b8606724 req-6a9e3837-fe9f-4301-a7ed-f3dffcaf1a6e service nova] Creating event network-vif-deleted:68ede3d7-0ef4-42a4-b3de-ef6046161db6 for instance 6447972e-6291-4e68-8271-c93523206230 on hv-cinder-81809 Nov 16 16:08:16.099704 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-7bd6fe6b-2e53-4f06-9e24-8f00b8606724 req-6a9e3837-fe9f-4301-a7ed-f3dffcaf1a6e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033471 Nov 16 16:08:16.104202 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 311/658] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:08:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:08:16.545491 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1cb6fc26-619b-4483-bf7a-64beb95be340 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:16.547171 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1cb6fc26-619b-4483-bf7a-64beb95be340 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:16.557900 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1cb6fc26-619b-4483-bf7a-64beb95be340 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:16.558665 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1cb6fc26-619b-4483-bf7a-64beb95be340 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:16.559745 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1cb6fc26-619b-4483-bf7a-64beb95be340 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:16.560377 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1cb6fc26-619b-4483-bf7a-64beb95be340 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:16.564271 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-4f7faf00-1c52-43d7-9a8d-600c4337c7f7 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:16.565156 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-4f7faf00-1c52-43d7-9a8d-600c4337c7f7 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] [instance: 8be6d15b-4901-4b1b-9d39-97378569d908] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:16.576600 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4f7faf00-1c52-43d7-9a8d-600c4337c7f7 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:16.577360 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4f7faf00-1c52-43d7-9a8d-600c4337c7f7 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:16.578313 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4f7faf00-1c52-43d7-9a8d-600c4337c7f7 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:16.579128 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4f7faf00-1c52-43d7-9a8d-600c4337c7f7 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:16.602074 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1cb6fc26-619b-4483-bf7a-64beb95be340 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:16.602769 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1cb6fc26-619b-4483-bf7a-64beb95be340 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:16.603403 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.objects.instance [None req-1cb6fc26-619b-4483-bf7a-64beb95be340 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lazy-loading 'fault' on Instance uuid 6447972e-6291-4e68-8271-c93523206230 {{(pid=116084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:08:16.670468 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1cb6fc26-619b-4483-bf7a-64beb95be340 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:16.687327 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1cb6fc26-619b-4483-bf7a-64beb95be340 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:16.688840 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1cb6fc26-619b-4483-bf7a-64beb95be340 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:16.697018 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1cb6fc26-619b-4483-bf7a-64beb95be340 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 200 len: 1371 microversion: 2.20 time: 0.155166 Nov 16 16:08:16.697492 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-4f7faf00-1c52-43d7-9a8d-600c4337c7f7 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fcb8d8c3d490e915fe9583f70cb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bf6ebc44c444e911ba343e1c14785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:16.701264 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 348/659] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:08:16 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:08:16.705175 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-4f7faf00-1c52-43d7-9a8d-600c4337c7f7 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] 10.222.0.46 "GET /compute/v2.1/servers/8be6d15b-4901-4b1b-9d39-97378569d908" status: 200 len: 1277 microversion: 2.1 time: 0.146569 Nov 16 16:08:16.706016 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 312/660] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:16 2021] GET /compute/v2.1/servers/8be6d15b-4901-4b1b-9d39-97378569d908 => generated 1277 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:08:17.719128 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6ec6106d-5068-4a67-a490-f69257a71593 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:17.720497 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-6ec6106d-5068-4a67-a490-f69257a71593 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:17.722780 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-0f3ebcdb-7844-429d-983a-33c1cf94dfa4 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:17.725098 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-0f3ebcdb-7844-429d-983a-33c1cf94dfa4 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] [instance: 8be6d15b-4901-4b1b-9d39-97378569d908] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:17.730876 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6ec6106d-5068-4a67-a490-f69257a71593 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:17.731243 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6ec6106d-5068-4a67-a490-f69257a71593 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:17.732067 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6ec6106d-5068-4a67-a490-f69257a71593 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:17.732504 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6ec6106d-5068-4a67-a490-f69257a71593 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:17.733276 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0f3ebcdb-7844-429d-983a-33c1cf94dfa4 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:17.733929 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0f3ebcdb-7844-429d-983a-33c1cf94dfa4 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:17.734904 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0f3ebcdb-7844-429d-983a-33c1cf94dfa4 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:17.735691 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0f3ebcdb-7844-429d-983a-33c1cf94dfa4 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:17.756232 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-6ec6106d-5068-4a67-a490-f69257a71593 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] HTTP exception thrown: Instance 6447972e-6291-4e68-8271-c93523206230 could not be found. Nov 16 16:08:17.756842 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6ec6106d-5068-4a67-a490-f69257a71593 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Returning 404 to user: Instance 6447972e-6291-4e68-8271-c93523206230 could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:08:17.757684 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-6ec6106d-5068-4a67-a490-f69257a71593 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 404 len: 111 microversion: 2.20 time: 0.042219 Nov 16 16:08:17.759315 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 349/661] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:08:17 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 16 16:08:17.768397 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-66d82053-35e2-4f58-82dc-f0fb86de342d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '.version_select at 0x7f113c426550>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:17.796979 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-66d82053-35e2-4f58-82dc-f0fb86de342d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1032225550" status: 204 len: 0 microversion: 2.20 time: 0.032289 Nov 16 16:08:17.797935 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 350/662] 10.222.0.46 () {60 vars in 1261 bytes} [Tue Nov 16 16:08:17 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1032225550 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 16 16:08:17.988848 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-0f3ebcdb-7844-429d-983a-33c1cf94dfa4 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fcb8d8c3d490e915fe9583f70cb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bf6ebc44c444e911ba343e1c14785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:17.994219 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-0f3ebcdb-7844-429d-983a-33c1cf94dfa4 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] 10.222.0.46 "GET /compute/v2.1/servers/8be6d15b-4901-4b1b-9d39-97378569d908" status: 200 len: 1319 microversion: 2.1 time: 0.275091 Nov 16 16:08:17.994981 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 313/663] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:17 2021] GET /compute/v2.1/servers/8be6d15b-4901-4b1b-9d39-97378569d908 => generated 1319 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:08:18.115952 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-a6d1a5b5-1702-4bc9-a373-251210f45630 req-41b32e70-5260-4dff-89dc-0a0b7afc51a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8be6d15b-4901-4b1b-9d39-97378569d908", "tag": "13e8233d-0121-4d55-835b-81b428667917"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:18.117592 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:08:18.117592 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Nov 16 16:08:18.126034 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-a6d1a5b5-1702-4bc9-a373-251210f45630 req-41b32e70-5260-4dff-89dc-0a0b7afc51a4 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:18.126782 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-a6d1a5b5-1702-4bc9-a373-251210f45630 req-41b32e70-5260-4dff-89dc-0a0b7afc51a4 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:18.140922 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-a6d1a5b5-1702-4bc9-a373-251210f45630 req-41b32e70-5260-4dff-89dc-0a0b7afc51a4 service nova] Creating event network-changed:13e8233d-0121-4d55-835b-81b428667917 for instance 8be6d15b-4901-4b1b-9d39-97378569d908 on hv-cinder-81809 Nov 16 16:08:18.146459 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-a6d1a5b5-1702-4bc9-a373-251210f45630 req-41b32e70-5260-4dff-89dc-0a0b7afc51a4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033884 Nov 16 16:08:18.147486 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 351/664] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:08:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:08:18.525636 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-4bd73732-9da8-460e-8b18-d0a2144950c2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'create', calling method: .version_select at 0x7f113c2dea60>, body: {"keypair": {"name": "tempest-keypair-1711441512"}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:18.539907 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-4bd73732-9da8-460e-8b18-d0a2144950c2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Getting quotas for project ae9bddc9870246e99f813976878279cb. Resources: {'key_pairs'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:08:18.543871 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-4bd73732-9da8-460e-8b18-d0a2144950c2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Getting quotas for user 00d8e37d934648708238997bded11462 and project ae9bddc9870246e99f813976878279cb. Resources: {'key_pairs'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:08:18.941977 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-4bd73732-9da8-460e-8b18-d0a2144950c2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Getting quotas for project ae9bddc9870246e99f813976878279cb. Resources: {'key_pairs'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:08:18.946264 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-4bd73732-9da8-460e-8b18-d0a2144950c2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Getting quotas for user 00d8e37d934648708238997bded11462 and project ae9bddc9870246e99f813976878279cb. Resources: {'key_pairs'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:08:18.959331 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-4bd73732-9da8-460e-8b18-d0a2144950c2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.437824 Nov 16 16:08:18.959961 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 314/665] 10.222.0.46 () {62 vars in 1198 bytes} [Tue Nov 16 16:08:18 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 439 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 16 16:08:19.013485 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6391cd1a-330b-4eb1-b26c-183c2ff984c2 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:19.014395 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-6391cd1a-330b-4eb1-b26c-183c2ff984c2 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] [instance: 8be6d15b-4901-4b1b-9d39-97378569d908] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:19.023946 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6391cd1a-330b-4eb1-b26c-183c2ff984c2 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:19.024777 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6391cd1a-330b-4eb1-b26c-183c2ff984c2 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:19.025696 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6391cd1a-330b-4eb1-b26c-183c2ff984c2 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:19.026242 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6391cd1a-330b-4eb1-b26c-183c2ff984c2 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:19.197611 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-6391cd1a-330b-4eb1-b26c-183c2ff984c2 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fcb8d8c3d490e915fe9583f70cb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bf6ebc44c444e911ba343e1c14785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:19.208684 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-6391cd1a-330b-4eb1-b26c-183c2ff984c2 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] 10.222.0.46 "GET /compute/v2.1/servers/8be6d15b-4901-4b1b-9d39-97378569d908" status: 200 len: 1319 microversion: 2.1 time: 0.200837 Nov 16 16:08:19.209656 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 352/666] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:19 2021] GET /compute/v2.1/servers/8be6d15b-4901-4b1b-9d39-97378569d908 => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:08:20.226696 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-75abf0fa-49eb-4d4c-ad4f-fe10b7a89620 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:20.227334 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-75abf0fa-49eb-4d4c-ad4f-fe10b7a89620 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] [instance: 8be6d15b-4901-4b1b-9d39-97378569d908] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:20.233382 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-75abf0fa-49eb-4d4c-ad4f-fe10b7a89620 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:20.233821 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-75abf0fa-49eb-4d4c-ad4f-fe10b7a89620 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:20.234585 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-75abf0fa-49eb-4d4c-ad4f-fe10b7a89620 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:20.235019 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-75abf0fa-49eb-4d4c-ad4f-fe10b7a89620 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:20.237089 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d9e466ad-fa85-4636-ad7c-0866a5238fdc tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1167573054", "imageRef": "7c3bd8e0-8d7e-4cf7-90db-742c4f55e405", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "72ea3377-b38c-416b-8581-98962c72f168"}], "security_groups": [{"name": "tempest-securitygroup--1949315392"}], "key_name": "tempest-keypair-1711441512", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:20.367779 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.network.neutron [None req-d9e466ad-fa85-4636-ad7c-0866a5238fdc tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] validate_networks() for [('72ea3377-b38c-416b-8581-98962c72f168', None, None, None, None, None)] {{(pid=116084) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 16:08:20.443709 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-75abf0fa-49eb-4d4c-ad4f-fe10b7a89620 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fcb8d8c3d490e915fe9583f70cb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bf6ebc44c444e911ba343e1c14785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:20.450963 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-75abf0fa-49eb-4d4c-ad4f-fe10b7a89620 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] 10.222.0.46 "GET /compute/v2.1/servers/8be6d15b-4901-4b1b-9d39-97378569d908" status: 200 len: 1319 microversion: 2.1 time: 0.228899 Nov 16 16:08:20.451546 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 315/667] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:20 2021] GET /compute/v2.1/servers/8be6d15b-4901-4b1b-9d39-97378569d908 => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:08:21.009164 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-d9e466ad-fa85-4636-ad7c-0866a5238fdc tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Flavor limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 16:08:21.009585 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-d9e466ad-fa85-4636-ad7c-0866a5238fdc tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Image limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 16:08:21.010057 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-d9e466ad-fa85-4636-ad7c-0866a5238fdc tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Flavor pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 16:08:21.010489 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-d9e466ad-fa85-4636-ad7c-0866a5238fdc tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Image pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 16:08:21.010900 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-d9e466ad-fa85-4636-ad7c-0866a5238fdc tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 16:08:21.020211 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d9e466ad-fa85-4636-ad7c-0866a5238fdc tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:21.020758 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d9e466ad-fa85-4636-ad7c-0866a5238fdc tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:21.021560 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d9e466ad-fa85-4636-ad7c-0866a5238fdc tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:21.021991 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d9e466ad-fa85-4636-ad7c-0866a5238fdc tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:21.038241 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-d9e466ad-fa85-4636-ad7c-0866a5238fdc tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Getting quotas for project ae9bddc9870246e99f813976878279cb. Resources: {'instances', 'ram', 'cores'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:08:21.042125 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-d9e466ad-fa85-4636-ad7c-0866a5238fdc tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Getting quotas for user 00d8e37d934648708238997bded11462 and project ae9bddc9870246e99f813976878279cb. Resources: {'instances', 'ram', 'cores'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:08:21.053548 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d9e466ad-fa85-4636-ad7c-0866a5238fdc tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Going to run 1 instances... {{(pid=116084) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 16:08:21.056298 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d9e466ad-fa85-4636-ad7c-0866a5238fdc tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c3bd8e0-8d7e-4cf7-90db-742c4f55e405',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116084) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 16:08:21.101213 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d9e466ad-fa85-4636-ad7c-0866a5238fdc tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.868174 Nov 16 16:08:21.102043 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 353/668] 10.222.0.46 () {62 vars in 1187 bytes} [Tue Nov 16 16:08:20 2021] POST /compute/v2.1/servers => generated 402 bytes in 869 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Nov 16 16:08:21.112246 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-0067edd7-36bf-4387-9bce-c11bc1887253 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:21.112861 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-0067edd7-36bf-4387-9bce-c11bc1887253 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:21.169764 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-0067edd7-36bf-4387-9bce-c11bc1887253 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:21.178059 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-0067edd7-36bf-4387-9bce-c11bc1887253 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:21.179838 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-0067edd7-36bf-4387-9bce-c11bc1887253 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:21.181016 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-0067edd7-36bf-4387-9bce-c11bc1887253 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 200 len: 1282 microversion: 2.20 time: 0.073051 Nov 16 16:08:21.181601 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 316/669] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:08:21 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 1282 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:08:21.468676 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7589c464-3d2b-4d2c-935f-5f553ec63397 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:21.469296 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-7589c464-3d2b-4d2c-935f-5f553ec63397 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] [instance: 8be6d15b-4901-4b1b-9d39-97378569d908] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:21.477521 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7589c464-3d2b-4d2c-935f-5f553ec63397 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:21.477965 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7589c464-3d2b-4d2c-935f-5f553ec63397 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:21.478775 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7589c464-3d2b-4d2c-935f-5f553ec63397 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:21.479221 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7589c464-3d2b-4d2c-935f-5f553ec63397 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:21.620963 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7589c464-3d2b-4d2c-935f-5f553ec63397 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fcb8d8c3d490e915fe9583f70cb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bf6ebc44c444e911ba343e1c14785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:21.628393 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-7589c464-3d2b-4d2c-935f-5f553ec63397 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] 10.222.0.46 "GET /compute/v2.1/servers/8be6d15b-4901-4b1b-9d39-97378569d908" status: 200 len: 1319 microversion: 2.1 time: 0.163853 Nov 16 16:08:21.628961 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 354/670] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:21 2021] GET /compute/v2.1/servers/8be6d15b-4901-4b1b-9d39-97378569d908 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:08:22.199878 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-7d23abf7-f65a-45d4-a3a6-1e7b6a328793 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:22.200492 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-7d23abf7-f65a-45d4-a3a6-1e7b6a328793 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:22.207207 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7d23abf7-f65a-45d4-a3a6-1e7b6a328793 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:22.208320 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7d23abf7-f65a-45d4-a3a6-1e7b6a328793 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:22.209104 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7d23abf7-f65a-45d4-a3a6-1e7b6a328793 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:22.209581 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7d23abf7-f65a-45d4-a3a6-1e7b6a328793 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:22.279638 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-7d23abf7-f65a-45d4-a3a6-1e7b6a328793 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:22.287641 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-7d23abf7-f65a-45d4-a3a6-1e7b6a328793 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:22.289139 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-7d23abf7-f65a-45d4-a3a6-1e7b6a328793 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:22.290293 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-7d23abf7-f65a-45d4-a3a6-1e7b6a328793 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 200 len: 1352 microversion: 2.20 time: 0.094069 Nov 16 16:08:22.290865 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 317/671] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:08:22 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:08:22.646252 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ef32f60c-65a2-4191-a3e3-10182a0a1db2 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:22.646862 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ef32f60c-65a2-4191-a3e3-10182a0a1db2 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] [instance: 8be6d15b-4901-4b1b-9d39-97378569d908] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:22.653339 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ef32f60c-65a2-4191-a3e3-10182a0a1db2 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:22.653788 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ef32f60c-65a2-4191-a3e3-10182a0a1db2 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:22.654781 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ef32f60c-65a2-4191-a3e3-10182a0a1db2 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:22.655232 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ef32f60c-65a2-4191-a3e3-10182a0a1db2 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:22.808337 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-9e4ab886-bde1-40b5-99fa-e1fefb34521b req-dc2af46f-899d-4a6b-850f-fd7381591092 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8be6d15b-4901-4b1b-9d39-97378569d908", "name": "network-vif-plugged", "status": "completed", "tag": "13e8233d-0121-4d55-835b-81b428667917"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:22.810111 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:08:22.810111 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Nov 16 16:08:22.819000 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-9e4ab886-bde1-40b5-99fa-e1fefb34521b req-dc2af46f-899d-4a6b-850f-fd7381591092 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:22.819579 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-9e4ab886-bde1-40b5-99fa-e1fefb34521b req-dc2af46f-899d-4a6b-850f-fd7381591092 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:22.832415 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-9e4ab886-bde1-40b5-99fa-e1fefb34521b req-dc2af46f-899d-4a6b-850f-fd7381591092 service nova] Creating event network-vif-plugged:13e8233d-0121-4d55-835b-81b428667917 for instance 8be6d15b-4901-4b1b-9d39-97378569d908 on hv-cinder-81809 Nov 16 16:08:22.837579 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-9e4ab886-bde1-40b5-99fa-e1fefb34521b req-dc2af46f-899d-4a6b-850f-fd7381591092 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032838 Nov 16 16:08:22.838185 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 318/672] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:08:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:08:22.872118 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ef32f60c-65a2-4191-a3e3-10182a0a1db2 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fcb8d8c3d490e915fe9583f70cb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bf6ebc44c444e911ba343e1c14785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:22.889690 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ef32f60c-65a2-4191-a3e3-10182a0a1db2 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] 10.222.0.46 "GET /compute/v2.1/servers/8be6d15b-4901-4b1b-9d39-97378569d908" status: 200 len: 1319 microversion: 2.1 time: 0.247349 Nov 16 16:08:22.899562 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 355/673] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:22 2021] GET /compute/v2.1/servers/8be6d15b-4901-4b1b-9d39-97378569d908 => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:08:23.309812 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-8a5c597a-25f3-401e-a34e-8c60c45e5b58 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:23.310517 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-8a5c597a-25f3-401e-a34e-8c60c45e5b58 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:23.316493 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8a5c597a-25f3-401e-a34e-8c60c45e5b58 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:23.316990 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8a5c597a-25f3-401e-a34e-8c60c45e5b58 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:23.317995 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8a5c597a-25f3-401e-a34e-8c60c45e5b58 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:23.318432 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8a5c597a-25f3-401e-a34e-8c60c45e5b58 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:23.556492 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-8a5c597a-25f3-401e-a34e-8c60c45e5b58 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:23.564283 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-8a5c597a-25f3-401e-a34e-8c60c45e5b58 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:23.565718 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-8a5c597a-25f3-401e-a34e-8c60c45e5b58 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:23.568356 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-8a5c597a-25f3-401e-a34e-8c60c45e5b58 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 200 len: 1408 microversion: 2.20 time: 0.262676 Nov 16 16:08:23.569131 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 319/674] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:08:23 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 1408 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:08:23.676684 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-bfeca825-d224-41f9-a91b-bc9d810d366b req-147a1e5f-6a8c-4508-84e0-f02a9506767c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6af3cc97-b45c-4fde-9c9c-47a91dd69630", "tag": "3d367ce8-61fa-49f0-b6d2-d3d025285525"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:23.680086 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:08:23.680086 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Nov 16 16:08:23.688751 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-bfeca825-d224-41f9-a91b-bc9d810d366b req-147a1e5f-6a8c-4508-84e0-f02a9506767c service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:23.689188 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-bfeca825-d224-41f9-a91b-bc9d810d366b req-147a1e5f-6a8c-4508-84e0-f02a9506767c service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:23.702737 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-bfeca825-d224-41f9-a91b-bc9d810d366b req-147a1e5f-6a8c-4508-84e0-f02a9506767c service nova] Creating event network-changed:3d367ce8-61fa-49f0-b6d2-d3d025285525 for instance 6af3cc97-b45c-4fde-9c9c-47a91dd69630 on hv-cinder-81809 Nov 16 16:08:23.707963 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-bfeca825-d224-41f9-a91b-bc9d810d366b req-147a1e5f-6a8c-4508-84e0-f02a9506767c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036326 Nov 16 16:08:23.709432 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 356/675] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:08:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:08:23.906730 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-9ed53721-3bf5-40ba-80d7-c0a58c604204 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:23.907428 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-9ed53721-3bf5-40ba-80d7-c0a58c604204 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] [instance: 8be6d15b-4901-4b1b-9d39-97378569d908] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:23.914945 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9ed53721-3bf5-40ba-80d7-c0a58c604204 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:23.915338 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9ed53721-3bf5-40ba-80d7-c0a58c604204 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:23.917950 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9ed53721-3bf5-40ba-80d7-c0a58c604204 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:23.918595 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9ed53721-3bf5-40ba-80d7-c0a58c604204 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:24.140689 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-9ed53721-3bf5-40ba-80d7-c0a58c604204 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fcb8d8c3d490e915fe9583f70cb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bf6ebc44c444e911ba343e1c14785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:24.149555 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-9ed53721-3bf5-40ba-80d7-c0a58c604204 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] 10.222.0.46 "GET /compute/v2.1/servers/8be6d15b-4901-4b1b-9d39-97378569d908" status: 200 len: 1319 microversion: 2.1 time: 0.246761 Nov 16 16:08:24.150138 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 320/676] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:23 2021] GET /compute/v2.1/servers/8be6d15b-4901-4b1b-9d39-97378569d908 => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:08:24.592268 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-225a1f65-0e30-4629-a898-4a271d2953ba tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:24.592890 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-225a1f65-0e30-4629-a898-4a271d2953ba tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:24.599029 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-225a1f65-0e30-4629-a898-4a271d2953ba tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:24.599509 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-225a1f65-0e30-4629-a898-4a271d2953ba tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:24.600333 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-225a1f65-0e30-4629-a898-4a271d2953ba tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:24.600776 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-225a1f65-0e30-4629-a898-4a271d2953ba tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:24.803618 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-225a1f65-0e30-4629-a898-4a271d2953ba tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:24.812464 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-225a1f65-0e30-4629-a898-4a271d2953ba tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:24.814065 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-225a1f65-0e30-4629-a898-4a271d2953ba tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:24.815210 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-225a1f65-0e30-4629-a898-4a271d2953ba tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 200 len: 1408 microversion: 2.20 time: 0.227105 Nov 16 16:08:24.815784 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 357/677] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:08:24 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 1408 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:08:25.166405 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-b2002902-4c11-4077-a288-0389ed86dd20 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:25.166988 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-b2002902-4c11-4077-a288-0389ed86dd20 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] [instance: 8be6d15b-4901-4b1b-9d39-97378569d908] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:25.173323 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b2002902-4c11-4077-a288-0389ed86dd20 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:25.173763 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b2002902-4c11-4077-a288-0389ed86dd20 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:25.174556 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b2002902-4c11-4077-a288-0389ed86dd20 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:25.174988 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b2002902-4c11-4077-a288-0389ed86dd20 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:25.305658 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-b2002902-4c11-4077-a288-0389ed86dd20 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fcb8d8c3d490e915fe9583f70cb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bf6ebc44c444e911ba343e1c14785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:25.312899 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-b2002902-4c11-4077-a288-0389ed86dd20 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] 10.222.0.46 "GET /compute/v2.1/servers/8be6d15b-4901-4b1b-9d39-97378569d908" status: 200 len: 1508 microversion: 2.1 time: 0.150163 Nov 16 16:08:25.313467 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 321/678] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:25 2021] GET /compute/v2.1/servers/8be6d15b-4901-4b1b-9d39-97378569d908 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:08:25.328881 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e81b1115-f0c0-4994-a002-9566a5407af2 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "57b5f899-549e-4e08-b08d-7cf90bc44fb6", "device": "/dev/sdb"}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:25.329958 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e81b1115-f0c0-4994-a002-9566a5407af2 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] [instance: 8be6d15b-4901-4b1b-9d39-97378569d908] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:25.336599 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e81b1115-f0c0-4994-a002-9566a5407af2 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:25.337051 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e81b1115-f0c0-4994-a002-9566a5407af2 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:25.337827 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e81b1115-f0c0-4994-a002-9566a5407af2 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:25.338263 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e81b1115-f0c0-4994-a002-9566a5407af2 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:25.571382 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e81b1115-f0c0-4994-a002-9566a5407af2 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] 10.222.0.46 "POST /compute/v2.1/servers/8be6d15b-4901-4b1b-9d39-97378569d908/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.245906 Nov 16 16:08:25.576485 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 358/679] 10.222.0.46 () {60 vars in 1322 bytes} [Tue Nov 16 16:08:25 2021] POST /compute/v2.1/servers/8be6d15b-4901-4b1b-9d39-97378569d908/os-volume_attachments => generated 194 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:08:25.833129 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-5419fbc7-55a3-4eeb-a4bd-d80f0b9922ce tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:25.833732 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-5419fbc7-55a3-4eeb-a4bd-d80f0b9922ce tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:25.839672 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5419fbc7-55a3-4eeb-a4bd-d80f0b9922ce tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:25.840121 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5419fbc7-55a3-4eeb-a4bd-d80f0b9922ce tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:25.840890 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5419fbc7-55a3-4eeb-a4bd-d80f0b9922ce tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:25.841355 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5419fbc7-55a3-4eeb-a4bd-d80f0b9922ce tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:25.987346 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-5419fbc7-55a3-4eeb-a4bd-d80f0b9922ce tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:25.996610 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-5419fbc7-55a3-4eeb-a4bd-d80f0b9922ce tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:25.998308 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-5419fbc7-55a3-4eeb-a4bd-d80f0b9922ce tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:25.999426 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-5419fbc7-55a3-4eeb-a4bd-d80f0b9922ce tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 200 len: 1408 microversion: 2.20 time: 0.170000 Nov 16 16:08:26.000025 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 322/680] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:08:25 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 1408 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:08:27.017878 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-47ab3f92-c16d-417c-a98a-9748a373e9df tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:27.018598 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-47ab3f92-c16d-417c-a98a-9748a373e9df tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:27.025882 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-47ab3f92-c16d-417c-a98a-9748a373e9df tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:27.026330 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-47ab3f92-c16d-417c-a98a-9748a373e9df tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:27.027370 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-47ab3f92-c16d-417c-a98a-9748a373e9df tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:27.027834 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-47ab3f92-c16d-417c-a98a-9748a373e9df tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:27.162230 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-47ab3f92-c16d-417c-a98a-9748a373e9df tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:27.169921 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-47ab3f92-c16d-417c-a98a-9748a373e9df tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:27.171489 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-47ab3f92-c16d-417c-a98a-9748a373e9df tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:27.172580 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-47ab3f92-c16d-417c-a98a-9748a373e9df tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 200 len: 1408 microversion: 2.20 time: 0.158768 Nov 16 16:08:27.173137 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 359/681] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:08:27 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:08:28.193946 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-123667e4-ae2b-420b-99ee-121b145a3a88 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:28.195320 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-123667e4-ae2b-420b-99ee-121b145a3a88 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:28.201646 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-123667e4-ae2b-420b-99ee-121b145a3a88 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:28.202088 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-123667e4-ae2b-420b-99ee-121b145a3a88 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:28.202858 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-123667e4-ae2b-420b-99ee-121b145a3a88 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:28.203287 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-123667e4-ae2b-420b-99ee-121b145a3a88 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:28.336107 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-123667e4-ae2b-420b-99ee-121b145a3a88 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:28.343850 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-123667e4-ae2b-420b-99ee-121b145a3a88 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:28.345336 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-123667e4-ae2b-420b-99ee-121b145a3a88 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:28.346432 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-123667e4-ae2b-420b-99ee-121b145a3a88 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 200 len: 1408 microversion: 2.20 time: 0.157573 Nov 16 16:08:28.346995 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 323/682] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:08:28 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:08:28.835737 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-57093ee9-139c-4b73-b180-b0e58dc51f6d req-cb2cfeec-adc2-405f-bc62-1f6f52d04a44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6af3cc97-b45c-4fde-9c9c-47a91dd69630", "name": "network-vif-plugged", "status": "completed", "tag": "3d367ce8-61fa-49f0-b6d2-d3d025285525"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:28.837334 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:08:28.837334 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Nov 16 16:08:28.844569 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-57093ee9-139c-4b73-b180-b0e58dc51f6d req-cb2cfeec-adc2-405f-bc62-1f6f52d04a44 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:28.845163 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-57093ee9-139c-4b73-b180-b0e58dc51f6d req-cb2cfeec-adc2-405f-bc62-1f6f52d04a44 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:28.857550 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-57093ee9-139c-4b73-b180-b0e58dc51f6d req-cb2cfeec-adc2-405f-bc62-1f6f52d04a44 service nova] Creating event network-vif-plugged:3d367ce8-61fa-49f0-b6d2-d3d025285525 for instance 6af3cc97-b45c-4fde-9c9c-47a91dd69630 on hv-cinder-81809 Nov 16 16:08:28.862174 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-57093ee9-139c-4b73-b180-b0e58dc51f6d req-cb2cfeec-adc2-405f-bc62-1f6f52d04a44 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030183 Nov 16 16:08:28.862777 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 360/683] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:08:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:08:29.364406 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-9e2a7ce6-7640-43ab-9317-5e442b66f979 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:29.365020 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-9e2a7ce6-7640-43ab-9317-5e442b66f979 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:29.371126 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9e2a7ce6-7640-43ab-9317-5e442b66f979 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:29.371602 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9e2a7ce6-7640-43ab-9317-5e442b66f979 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:29.372370 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9e2a7ce6-7640-43ab-9317-5e442b66f979 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:29.372795 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9e2a7ce6-7640-43ab-9317-5e442b66f979 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:29.504285 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-9e2a7ce6-7640-43ab-9317-5e442b66f979 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:29.512431 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-9e2a7ce6-7640-43ab-9317-5e442b66f979 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:29.513932 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-9e2a7ce6-7640-43ab-9317-5e442b66f979 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:29.515038 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-9e2a7ce6-7640-43ab-9317-5e442b66f979 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 200 len: 1408 microversion: 2.20 time: 0.154473 Nov 16 16:08:29.515626 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 324/684] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:08:29 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:08:30.534759 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3f83c4b2-035d-4387-8c0c-9781089e1e16 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:30.536649 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-3f83c4b2-035d-4387-8c0c-9781089e1e16 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:30.542954 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3f83c4b2-035d-4387-8c0c-9781089e1e16 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:30.543411 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3f83c4b2-035d-4387-8c0c-9781089e1e16 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:30.544215 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3f83c4b2-035d-4387-8c0c-9781089e1e16 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:30.544648 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3f83c4b2-035d-4387-8c0c-9781089e1e16 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:30.675370 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-3f83c4b2-035d-4387-8c0c-9781089e1e16 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:30.683160 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-3f83c4b2-035d-4387-8c0c-9781089e1e16 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:30.684687 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-3f83c4b2-035d-4387-8c0c-9781089e1e16 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:30.685827 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-3f83c4b2-035d-4387-8c0c-9781089e1e16 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 200 len: 1600 microversion: 2.20 time: 0.155617 Nov 16 16:08:30.686384 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 361/685] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:08:30 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:08:30.702851 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-eabe9a21-862c-44d3-ae54-8d08a3180f79 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:30.703354 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-eabe9a21-862c-44d3-ae54-8d08a3180f79 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:30.710172 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-eabe9a21-862c-44d3-ae54-8d08a3180f79 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:30.710615 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-eabe9a21-862c-44d3-ae54-8d08a3180f79 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:30.711396 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-eabe9a21-862c-44d3-ae54-8d08a3180f79 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:30.711927 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-eabe9a21-862c-44d3-ae54-8d08a3180f79 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:30.790526 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-eabe9a21-862c-44d3-ae54-8d08a3180f79 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.091275 Nov 16 16:08:30.791164 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 325/686] 10.222.0.46 () {60 vars in 1315 bytes} [Tue Nov 16 16:08:30 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:08:31.947352 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-68401064-e6bd-4ed8-8aa5-b3d405e4013c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:31.951867 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-68401064-e6bd-4ed8-8aa5-b3d405e4013c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:31.952132 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-109a3aa0-5f04-4152-9ffe-20d4e1dbd4e5 req-fd4e525f-0211-4c74-bfce-260fd6045e35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6af3cc97-b45c-4fde-9c9c-47a91dd69630", "tag": "3d367ce8-61fa-49f0-b6d2-d3d025285525"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:31.953649 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:08:31.953649 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Nov 16 16:08:31.959649 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-68401064-e6bd-4ed8-8aa5-b3d405e4013c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:31.960434 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-68401064-e6bd-4ed8-8aa5-b3d405e4013c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:31.961207 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-109a3aa0-5f04-4152-9ffe-20d4e1dbd4e5 req-fd4e525f-0211-4c74-bfce-260fd6045e35 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:31.961351 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-68401064-e6bd-4ed8-8aa5-b3d405e4013c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:31.961703 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-68401064-e6bd-4ed8-8aa5-b3d405e4013c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:31.961830 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-109a3aa0-5f04-4152-9ffe-20d4e1dbd4e5 req-fd4e525f-0211-4c74-bfce-260fd6045e35 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:31.975749 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-109a3aa0-5f04-4152-9ffe-20d4e1dbd4e5 req-fd4e525f-0211-4c74-bfce-260fd6045e35 service nova] Creating event network-changed:3d367ce8-61fa-49f0-b6d2-d3d025285525 for instance 6af3cc97-b45c-4fde-9c9c-47a91dd69630 on hv-cinder-81809 Nov 16 16:08:31.982408 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-109a3aa0-5f04-4152-9ffe-20d4e1dbd4e5 req-fd4e525f-0211-4c74-bfce-260fd6045e35 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033511 Nov 16 16:08:31.983457 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 326/687] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:08:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:08:32.044167 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-68401064-e6bd-4ed8-8aa5-b3d405e4013c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action" status: 200 len: 14 microversion: 2.20 time: 0.100308 Nov 16 16:08:32.045274 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 362/688] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:08:31 2021] POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:08:33.057043 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-05f862b1-8b09-40ec-a3b5-2c6db4497041 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:33.058076 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-05f862b1-8b09-40ec-a3b5-2c6db4497041 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:33.064718 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-05f862b1-8b09-40ec-a3b5-2c6db4497041 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:33.065079 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-05f862b1-8b09-40ec-a3b5-2c6db4497041 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:33.066112 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-05f862b1-8b09-40ec-a3b5-2c6db4497041 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:33.066580 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-05f862b1-8b09-40ec-a3b5-2c6db4497041 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:33.134883 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-05f862b1-8b09-40ec-a3b5-2c6db4497041 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action" status: 200 len: 14 microversion: 2.20 time: 0.082258 Nov 16 16:08:33.138324 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 327/689] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:08:33 2021] POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:08:34.147019 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-eea9f140-4b15-4eef-82c5-de084d07fb3b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:34.148048 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-eea9f140-4b15-4eef-82c5-de084d07fb3b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:34.155076 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-eea9f140-4b15-4eef-82c5-de084d07fb3b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:34.155558 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-eea9f140-4b15-4eef-82c5-de084d07fb3b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:34.156336 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-eea9f140-4b15-4eef-82c5-de084d07fb3b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:34.156773 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-eea9f140-4b15-4eef-82c5-de084d07fb3b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:35.118060 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-a5c0e93b-8297-40d8-aba1-e4385570d404 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:35.119085 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-a5c0e93b-8297-40d8-aba1-e4385570d404 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:35.126081 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a5c0e93b-8297-40d8-aba1-e4385570d404 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:35.126526 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a5c0e93b-8297-40d8-aba1-e4385570d404 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:35.127289 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a5c0e93b-8297-40d8-aba1-e4385570d404 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:35.127748 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a5c0e93b-8297-40d8-aba1-e4385570d404 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:35.196289 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-a5c0e93b-8297-40d8-aba1-e4385570d404 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "POST /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d/action" status: 202 len: 0 microversion: 2.1 time: 0.082219 Nov 16 16:08:35.196981 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 328/690] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:08:35 2021] POST /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 16 16:08:35.204987 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-ce8b29d9-07c1-454f-b325-ad4c866ce3b8 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:35.205713 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-ce8b29d9-07c1-454f-b325-ad4c866ce3b8 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:35.212296 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ce8b29d9-07c1-454f-b325-ad4c866ce3b8 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:35.212747 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ce8b29d9-07c1-454f-b325-ad4c866ce3b8 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:35.213558 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ce8b29d9-07c1-454f-b325-ad4c866ce3b8 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:35.213993 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ce8b29d9-07c1-454f-b325-ad4c866ce3b8 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:35.371982 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-ce8b29d9-07c1-454f-b325-ad4c866ce3b8 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a73e3dbb5a4da5976643ad8224f56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ed7321198471eb4645081b697d234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:35.380275 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-ce8b29d9-07c1-454f-b325-ad4c866ce3b8 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d" status: 200 len: 1751 microversion: 2.1 time: 0.179074 Nov 16 16:08:35.380841 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 329/691] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:35 2021] GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d => generated 1751 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:08:36.397121 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-28f4b2f4-68ff-4e2b-a819-59aae7311ea9 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:36.397744 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-28f4b2f4-68ff-4e2b-a819-59aae7311ea9 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:36.404648 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-28f4b2f4-68ff-4e2b-a819-59aae7311ea9 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:36.405183 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-28f4b2f4-68ff-4e2b-a819-59aae7311ea9 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:36.406412 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-28f4b2f4-68ff-4e2b-a819-59aae7311ea9 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:36.406853 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-28f4b2f4-68ff-4e2b-a819-59aae7311ea9 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:36.465052 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-eea9f140-4b15-4eef-82c5-de084d07fb3b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action" status: 200 len: 14 microversion: 2.20 time: 2.322446 Nov 16 16:08:36.468209 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 363/692] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:08:34 2021] POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action => generated 14 bytes in 2324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:08:36.585470 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-28f4b2f4-68ff-4e2b-a819-59aae7311ea9 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a73e3dbb5a4da5976643ad8224f56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ed7321198471eb4645081b697d234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:36.593340 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-28f4b2f4-68ff-4e2b-a819-59aae7311ea9 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d" status: 200 len: 1751 microversion: 2.1 time: 0.200627 Nov 16 16:08:36.593910 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 330/693] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:36 2021] GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d => generated 1751 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:08:37.477346 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-5a8710f7-ccb0-4c01-8ce9-3998da91c42c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:37.478478 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-5a8710f7-ccb0-4c01-8ce9-3998da91c42c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:37.485942 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5a8710f7-ccb0-4c01-8ce9-3998da91c42c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:37.486387 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5a8710f7-ccb0-4c01-8ce9-3998da91c42c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:37.487155 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5a8710f7-ccb0-4c01-8ce9-3998da91c42c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:37.487607 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5a8710f7-ccb0-4c01-8ce9-3998da91c42c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:37.549860 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-5a8710f7-ccb0-4c01-8ce9-3998da91c42c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action" status: 200 len: 14 microversion: 2.20 time: 0.077084 Nov 16 16:08:37.554183 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 364/694] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:08:37 2021] POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:08:37.610628 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-7b1f6046-4854-455c-b82a-2ea8742cd692 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:37.611240 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-7b1f6046-4854-455c-b82a-2ea8742cd692 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:37.617521 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7b1f6046-4854-455c-b82a-2ea8742cd692 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:37.617963 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7b1f6046-4854-455c-b82a-2ea8742cd692 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:37.618731 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7b1f6046-4854-455c-b82a-2ea8742cd692 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:37.619166 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7b1f6046-4854-455c-b82a-2ea8742cd692 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:37.771683 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-7b1f6046-4854-455c-b82a-2ea8742cd692 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a73e3dbb5a4da5976643ad8224f56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ed7321198471eb4645081b697d234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:37.779768 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-7b1f6046-4854-455c-b82a-2ea8742cd692 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d" status: 200 len: 1756 microversion: 2.1 time: 0.172947 Nov 16 16:08:37.780334 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 331/695] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:37 2021] GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:08:38.562172 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-32bb3617-8f08-4eb3-b55d-f159807474ed tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:38.563186 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-32bb3617-8f08-4eb3-b55d-f159807474ed tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:38.570071 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-32bb3617-8f08-4eb3-b55d-f159807474ed tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:38.570511 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-32bb3617-8f08-4eb3-b55d-f159807474ed tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:38.571274 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-32bb3617-8f08-4eb3-b55d-f159807474ed tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:38.571728 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-32bb3617-8f08-4eb3-b55d-f159807474ed tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:38.806118 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-4606c3ac-3a73-483a-b60d-58efb4e3fe83 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:38.806721 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-4606c3ac-3a73-483a-b60d-58efb4e3fe83 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:38.813038 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4606c3ac-3a73-483a-b60d-58efb4e3fe83 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:38.813420 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4606c3ac-3a73-483a-b60d-58efb4e3fe83 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:38.814188 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4606c3ac-3a73-483a-b60d-58efb4e3fe83 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:38.814616 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4606c3ac-3a73-483a-b60d-58efb4e3fe83 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:38.960292 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-4606c3ac-3a73-483a-b60d-58efb4e3fe83 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a73e3dbb5a4da5976643ad8224f56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ed7321198471eb4645081b697d234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:38.972102 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-4606c3ac-3a73-483a-b60d-58efb4e3fe83 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d" status: 200 len: 1756 microversion: 2.1 time: 0.169568 Nov 16 16:08:38.973351 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 332/696] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:38 2021] GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:08:39.989822 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-4c95bdad-426b-4850-9da3-466f7529f8db tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:39.990518 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-4c95bdad-426b-4850-9da3-466f7529f8db tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:39.996594 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4c95bdad-426b-4850-9da3-466f7529f8db tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:39.997032 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4c95bdad-426b-4850-9da3-466f7529f8db tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:39.997795 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4c95bdad-426b-4850-9da3-466f7529f8db tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:39.998224 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4c95bdad-426b-4850-9da3-466f7529f8db tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:40.141531 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-4c95bdad-426b-4850-9da3-466f7529f8db tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a73e3dbb5a4da5976643ad8224f56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ed7321198471eb4645081b697d234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:40.150445 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-4c95bdad-426b-4850-9da3-466f7529f8db tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d" status: 200 len: 1756 microversion: 2.1 time: 0.164315 Nov 16 16:08:40.151014 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 333/697] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:39 2021] GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:08:40.564071 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-32bb3617-8f08-4eb3-b55d-f159807474ed tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action" status: 200 len: 14 microversion: 2.20 time: 2.005715 Nov 16 16:08:40.564880 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 365/698] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:08:38 2021] POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action => generated 14 bytes in 2008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:08:41.167706 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-bdffbe14-6ff0-474b-b1b7-8b5c17a2c304 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:41.168316 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-bdffbe14-6ff0-474b-b1b7-8b5c17a2c304 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:41.174518 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bdffbe14-6ff0-474b-b1b7-8b5c17a2c304 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:41.174966 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bdffbe14-6ff0-474b-b1b7-8b5c17a2c304 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:41.176280 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bdffbe14-6ff0-474b-b1b7-8b5c17a2c304 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:41.176721 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bdffbe14-6ff0-474b-b1b7-8b5c17a2c304 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:41.317649 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-bdffbe14-6ff0-474b-b1b7-8b5c17a2c304 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a73e3dbb5a4da5976643ad8224f56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ed7321198471eb4645081b697d234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:41.325321 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-bdffbe14-6ff0-474b-b1b7-8b5c17a2c304 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d" status: 200 len: 1756 microversion: 2.1 time: 0.161311 Nov 16 16:08:41.325887 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 334/699] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:41 2021] GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:08:41.575390 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-8a99394b-0ecb-490d-bea1-c59cdad7ebaa tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:41.576416 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-8a99394b-0ecb-490d-bea1-c59cdad7ebaa tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:41.583976 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8a99394b-0ecb-490d-bea1-c59cdad7ebaa tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:41.584431 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8a99394b-0ecb-490d-bea1-c59cdad7ebaa tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:41.585220 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8a99394b-0ecb-490d-bea1-c59cdad7ebaa tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:41.585661 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8a99394b-0ecb-490d-bea1-c59cdad7ebaa tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:41.654241 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-8a99394b-0ecb-490d-bea1-c59cdad7ebaa tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action" status: 200 len: 14 microversion: 2.20 time: 0.082733 Nov 16 16:08:41.654880 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 366/700] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:08:41 2021] POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:08:42.343197 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-0c97a78b-358c-4acc-a9cd-3f9635903a66 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:42.344556 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-0c97a78b-358c-4acc-a9cd-3f9635903a66 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:42.351444 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0c97a78b-358c-4acc-a9cd-3f9635903a66 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:42.352073 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0c97a78b-358c-4acc-a9cd-3f9635903a66 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:42.352980 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0c97a78b-358c-4acc-a9cd-3f9635903a66 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:42.353417 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0c97a78b-358c-4acc-a9cd-3f9635903a66 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:42.499862 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-0c97a78b-358c-4acc-a9cd-3f9635903a66 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a73e3dbb5a4da5976643ad8224f56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ed7321198471eb4645081b697d234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:42.507792 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-0c97a78b-358c-4acc-a9cd-3f9635903a66 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d" status: 200 len: 1756 microversion: 2.1 time: 0.169152 Nov 16 16:08:42.508354 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 335/701] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:42 2021] GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:08:42.518166 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-98dc96a6-764d-45bf-af02-071f5073776b tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:42.518792 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-98dc96a6-764d-45bf-af02-071f5073776b tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: db94bd78-8ff3-4784-84bd-e09796f6633a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:42.526605 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-98dc96a6-764d-45bf-af02-071f5073776b tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:42.527069 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-98dc96a6-764d-45bf-af02-071f5073776b tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:42.527890 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-98dc96a6-764d-45bf-af02-071f5073776b tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:42.528331 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-98dc96a6-764d-45bf-af02-071f5073776b tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:42.553646 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-98dc96a6-764d-45bf-af02-071f5073776b tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: db94bd78-8ff3-4784-84bd-e09796f6633a] Going to try to terminate instance {{(pid=116084) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 16:08:42.624651 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-98dc96a6-764d-45bf-af02-071f5073776b tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "DELETE /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a" status: 204 len: 0 microversion: 2.1 time: 0.110330 Nov 16 16:08:42.625346 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 367/702] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 16 16:08:42 2021] DELETE /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 16:08:42.634244 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-456d0e2a-258d-4962-8614-e30b2bf00f2f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:42.634747 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-456d0e2a-258d-4962-8614-e30b2bf00f2f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: db94bd78-8ff3-4784-84bd-e09796f6633a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:42.640573 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-456d0e2a-258d-4962-8614-e30b2bf00f2f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:42.641046 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-456d0e2a-258d-4962-8614-e30b2bf00f2f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:42.641848 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-456d0e2a-258d-4962-8614-e30b2bf00f2f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:42.642280 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-456d0e2a-258d-4962-8614-e30b2bf00f2f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:42.667396 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d7151cd2-147f-4c0b-9bc2-fa7250885ed9 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:42.668469 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d7151cd2-147f-4c0b-9bc2-fa7250885ed9 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:42.676596 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d7151cd2-147f-4c0b-9bc2-fa7250885ed9 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:42.677068 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d7151cd2-147f-4c0b-9bc2-fa7250885ed9 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:42.677869 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d7151cd2-147f-4c0b-9bc2-fa7250885ed9 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:42.678310 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d7151cd2-147f-4c0b-9bc2-fa7250885ed9 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:42.744469 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d7151cd2-147f-4c0b-9bc2-fa7250885ed9 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action" status: 200 len: 14 microversion: 2.20 time: 0.081894 Nov 16 16:08:42.747393 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 368/703] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:08:42 2021] POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:08:42.781570 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-456d0e2a-258d-4962-8614-e30b2bf00f2f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:42.789429 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-456d0e2a-258d-4962-8614-e30b2bf00f2f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a" status: 200 len: 1578 microversion: 2.1 time: 0.158813 Nov 16 16:08:42.791493 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 336/704] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:42 2021] GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:08:43.525654 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b4b98b91-862e-4418-b73c-cff20c97f5c1 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:43.526589 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b4b98b91-862e-4418-b73c-cff20c97f5c1 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:43.533384 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b4b98b91-862e-4418-b73c-cff20c97f5c1 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:43.533824 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b4b98b91-862e-4418-b73c-cff20c97f5c1 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:43.534588 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b4b98b91-862e-4418-b73c-cff20c97f5c1 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:43.535704 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b4b98b91-862e-4418-b73c-cff20c97f5c1 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:43.683715 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b4b98b91-862e-4418-b73c-cff20c97f5c1 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a73e3dbb5a4da5976643ad8224f56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ed7321198471eb4645081b697d234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:43.691712 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b4b98b91-862e-4418-b73c-cff20c97f5c1 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d" status: 200 len: 1756 microversion: 2.1 time: 0.170047 Nov 16 16:08:43.692284 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 369/705] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:43 2021] GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:08:43.755390 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-b7754e49-ded7-4f69-83f4-022db9ba3544 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:43.756383 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-b7754e49-ded7-4f69-83f4-022db9ba3544 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:43.763012 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b7754e49-ded7-4f69-83f4-022db9ba3544 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:43.763511 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b7754e49-ded7-4f69-83f4-022db9ba3544 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:43.764296 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b7754e49-ded7-4f69-83f4-022db9ba3544 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:43.764734 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b7754e49-ded7-4f69-83f4-022db9ba3544 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:43.807521 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-565c7ce6-1af4-4cac-b595-d16059bd1e04 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:43.808144 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-565c7ce6-1af4-4cac-b595-d16059bd1e04 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: db94bd78-8ff3-4784-84bd-e09796f6633a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:43.814544 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-565c7ce6-1af4-4cac-b595-d16059bd1e04 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:43.814994 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-565c7ce6-1af4-4cac-b595-d16059bd1e04 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:43.815804 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-565c7ce6-1af4-4cac-b595-d16059bd1e04 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:43.816382 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-565c7ce6-1af4-4cac-b595-d16059bd1e04 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:43.833197 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-b7754e49-ded7-4f69-83f4-022db9ba3544 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action" status: 200 len: 14 microversion: 2.20 time: 0.081213 Nov 16 16:08:43.834505 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 337/706] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:08:43 2021] POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:08:43.952445 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-565c7ce6-1af4-4cac-b595-d16059bd1e04 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:43.964378 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-565c7ce6-1af4-4cac-b595-d16059bd1e04 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a" status: 200 len: 1578 microversion: 2.1 time: 0.160476 Nov 16 16:08:43.964948 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 370/707] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:43 2021] GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a => generated 1578 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:08:44.712872 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-8842415b-d9c6-4d9d-9c1b-76b87ddc750b tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:44.713667 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-8842415b-d9c6-4d9d-9c1b-76b87ddc750b tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:44.721874 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8842415b-d9c6-4d9d-9c1b-76b87ddc750b tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:44.722618 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8842415b-d9c6-4d9d-9c1b-76b87ddc750b tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:44.723799 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8842415b-d9c6-4d9d-9c1b-76b87ddc750b tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:44.724236 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8842415b-d9c6-4d9d-9c1b-76b87ddc750b tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:44.844177 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ea551537-d28a-4849-a739-697f4d2f6812 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:44.845146 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ea551537-d28a-4849-a739-697f4d2f6812 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:44.851495 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ea551537-d28a-4849-a739-697f4d2f6812 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:44.851981 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ea551537-d28a-4849-a739-697f4d2f6812 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:44.852764 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ea551537-d28a-4849-a739-697f4d2f6812 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:44.853202 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ea551537-d28a-4849-a739-697f4d2f6812 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:44.927791 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ea551537-d28a-4849-a739-697f4d2f6812 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action" status: 200 len: 8481 microversion: 2.20 time: 0.087021 Nov 16 16:08:44.928357 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 371/708] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:08:44 2021] POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action => generated 8481 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:08:44.967113 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-8842415b-d9c6-4d9d-9c1b-76b87ddc750b tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a73e3dbb5a4da5976643ad8224f56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ed7321198471eb4645081b697d234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:44.977123 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-8842415b-d9c6-4d9d-9c1b-76b87ddc750b tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d" status: 200 len: 1756 microversion: 2.1 time: 0.268472 Nov 16 16:08:44.978213 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 338/709] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:44 2021] GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d => generated 1756 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:08:44.987161 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-daf0d42f-bfbd-4037-a373-fe006537e964 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:44.987719 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-daf0d42f-bfbd-4037-a373-fe006537e964 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] [instance: 8be6d15b-4901-4b1b-9d39-97378569d908] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:44.991772 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0df1d944-dcdd-4eb3-bd5d-9149d20279a7 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:44.992470 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0df1d944-dcdd-4eb3-bd5d-9149d20279a7 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: db94bd78-8ff3-4784-84bd-e09796f6633a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:44.994235 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-daf0d42f-bfbd-4037-a373-fe006537e964 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:44.994683 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-daf0d42f-bfbd-4037-a373-fe006537e964 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:44.995485 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-daf0d42f-bfbd-4037-a373-fe006537e964 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:44.995921 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-daf0d42f-bfbd-4037-a373-fe006537e964 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:44.999003 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0df1d944-dcdd-4eb3-bd5d-9149d20279a7 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:44.999452 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0df1d944-dcdd-4eb3-bd5d-9149d20279a7 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:45.000253 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0df1d944-dcdd-4eb3-bd5d-9149d20279a7 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:45.000681 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0df1d944-dcdd-4eb3-bd5d-9149d20279a7 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:45.083379 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.objects.instance [None req-daf0d42f-bfbd-4037-a373-fe006537e964 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lazy-loading 'services' on Instance uuid 8be6d15b-4901-4b1b-9d39-97378569d908 {{(pid=116085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:08:45.154912 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-daf0d42f-bfbd-4037-a373-fe006537e964 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8be6d15b-4901-4b1b-9d39-97378569d908/os-volume_attachments/57b5f899-549e-4e08-b08d-7cf90bc44fb6" status: 202 len: 0 microversion: 2.1 time: 0.171057 Nov 16 16:08:45.158690 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 339/710] 10.222.0.46 () {58 vars in 1415 bytes} [Tue Nov 16 16:08:44 2021] DELETE /compute/v2.1/servers/8be6d15b-4901-4b1b-9d39-97378569d908/os-volume_attachments/57b5f899-549e-4e08-b08d-7cf90bc44fb6 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:08:45.265834 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0df1d944-dcdd-4eb3-bd5d-9149d20279a7 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:45.276217 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0df1d944-dcdd-4eb3-bd5d-9149d20279a7 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a" status: 200 len: 1578 microversion: 2.1 time: 0.288538 Nov 16 16:08:45.277224 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 372/711] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:44 2021] GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a => generated 1578 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:08:45.660795 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-a771c0f6-d284-4daf-8ca2-739f2caf9524 req-56cb00f5-751c-45b4-9cae-254f6f241abd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db94bd78-8ff3-4784-84bd-e09796f6633a", "name": "network-vif-deleted", "tag": "b063cfec-1c51-450b-a10e-50021e43d561"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:45.662315 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:08:45.662315 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Nov 16 16:08:45.672926 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-a771c0f6-d284-4daf-8ca2-739f2caf9524 req-56cb00f5-751c-45b4-9cae-254f6f241abd service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:45.673612 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-a771c0f6-d284-4daf-8ca2-739f2caf9524 req-56cb00f5-751c-45b4-9cae-254f6f241abd service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:45.687843 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-a771c0f6-d284-4daf-8ca2-739f2caf9524 req-56cb00f5-751c-45b4-9cae-254f6f241abd service nova] Creating event network-vif-deleted:b063cfec-1c51-450b-a10e-50021e43d561 for instance db94bd78-8ff3-4784-84bd-e09796f6633a on hv-cinder-81809 Nov 16 16:08:45.693984 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-a771c0f6-d284-4daf-8ca2-739f2caf9524 req-56cb00f5-751c-45b4-9cae-254f6f241abd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038156 Nov 16 16:08:45.695012 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 340/712] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:08:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:08:45.938167 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a4f3c860-ac4c-4163-9379-94e4d986dff0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:45.939191 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-a4f3c860-ac4c-4163-9379-94e4d986dff0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:45.947482 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a4f3c860-ac4c-4163-9379-94e4d986dff0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:45.948274 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a4f3c860-ac4c-4163-9379-94e4d986dff0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:45.949005 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a4f3c860-ac4c-4163-9379-94e4d986dff0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:45.949519 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a4f3c860-ac4c-4163-9379-94e4d986dff0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:45.994914 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-a5cecffa-4b7c-44e6-b36f-2e2688b3060d tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:45.996469 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-a5cecffa-4b7c-44e6-b36f-2e2688b3060d tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:46.008598 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a5cecffa-4b7c-44e6-b36f-2e2688b3060d tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:46.009918 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a5cecffa-4b7c-44e6-b36f-2e2688b3060d tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:46.011136 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a5cecffa-4b7c-44e6-b36f-2e2688b3060d tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:46.011874 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a5cecffa-4b7c-44e6-b36f-2e2688b3060d tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:46.040107 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-a4f3c860-ac4c-4163-9379-94e4d986dff0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action" status: 200 len: 15025 microversion: 2.20 time: 0.096980 Nov 16 16:08:46.042116 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 373/713] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:08:45 2021] POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action => generated 15025 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:08:46.176543 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-a5cecffa-4b7c-44e6-b36f-2e2688b3060d tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a73e3dbb5a4da5976643ad8224f56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ed7321198471eb4645081b697d234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:46.184606 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-a5cecffa-4b7c-44e6-b36f-2e2688b3060d tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d" status: 200 len: 1756 microversion: 2.1 time: 0.193978 Nov 16 16:08:46.195109 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 341/714] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:45 2021] GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d => generated 1756 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:08:46.270608 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a40504e6-640e-4aae-a9df-8561866e9b4e tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:46.271234 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-a40504e6-640e-4aae-a9df-8561866e9b4e tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] [instance: 8be6d15b-4901-4b1b-9d39-97378569d908] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:46.278398 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a40504e6-640e-4aae-a9df-8561866e9b4e tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:46.278849 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a40504e6-640e-4aae-a9df-8561866e9b4e tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:46.279674 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a40504e6-640e-4aae-a9df-8561866e9b4e tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:46.280117 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a40504e6-640e-4aae-a9df-8561866e9b4e tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:46.293778 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-3561bbba-350e-4301-a5f7-084d74c158d8 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:46.294873 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-3561bbba-350e-4301-a5f7-084d74c158d8 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: db94bd78-8ff3-4784-84bd-e09796f6633a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:46.300546 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3561bbba-350e-4301-a5f7-084d74c158d8 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:46.301120 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3561bbba-350e-4301-a5f7-084d74c158d8 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:46.302033 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3561bbba-350e-4301-a5f7-084d74c158d8 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:46.302567 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3561bbba-350e-4301-a5f7-084d74c158d8 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:46.305477 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-a40504e6-640e-4aae-a9df-8561866e9b4e tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] [instance: 8be6d15b-4901-4b1b-9d39-97378569d908] Going to try to terminate instance {{(pid=116084) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 16:08:46.337035 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3561bbba-350e-4301-a5f7-084d74c158d8 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:46.337592 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3561bbba-350e-4301-a5f7-084d74c158d8 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:46.338301 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.objects.instance [None req-3561bbba-350e-4301-a5f7-084d74c158d8 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lazy-loading 'fault' on Instance uuid db94bd78-8ff3-4784-84bd-e09796f6633a {{(pid=116085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:08:46.381501 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-3561bbba-350e-4301-a5f7-084d74c158d8 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:46.393284 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-3561bbba-350e-4301-a5f7-084d74c158d8 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a" status: 200 len: 1231 microversion: 2.1 time: 0.103061 Nov 16 16:08:46.396304 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 342/715] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:46 2021] GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a => generated 1231 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:08:46.429066 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-a40504e6-640e-4aae-a9df-8561866e9b4e tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8be6d15b-4901-4b1b-9d39-97378569d908" status: 204 len: 0 microversion: 2.1 time: 0.162874 Nov 16 16:08:46.429772 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 374/716] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 16 16:08:46 2021] DELETE /compute/v2.1/servers/8be6d15b-4901-4b1b-9d39-97378569d908 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 16:08:46.437808 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-de9213ae-a9c6-4b65-acb5-4edf1c4a19a9 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:46.438431 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-de9213ae-a9c6-4b65-acb5-4edf1c4a19a9 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] [instance: 8be6d15b-4901-4b1b-9d39-97378569d908] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:46.445600 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-de9213ae-a9c6-4b65-acb5-4edf1c4a19a9 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:46.446050 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-de9213ae-a9c6-4b65-acb5-4edf1c4a19a9 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:46.447180 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-de9213ae-a9c6-4b65-acb5-4edf1c4a19a9 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:46.447299 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-de9213ae-a9c6-4b65-acb5-4edf1c4a19a9 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:46.594273 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-de9213ae-a9c6-4b65-acb5-4edf1c4a19a9 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fcb8d8c3d490e915fe9583f70cb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bf6ebc44c444e911ba343e1c14785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:46.602411 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-de9213ae-a9c6-4b65-acb5-4edf1c4a19a9 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] 10.222.0.46 "GET /compute/v2.1/servers/8be6d15b-4901-4b1b-9d39-97378569d908" status: 200 len: 1514 microversion: 2.1 time: 0.168342 Nov 16 16:08:46.602993 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 343/717] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:46 2021] GET /compute/v2.1/servers/8be6d15b-4901-4b1b-9d39-97378569d908 => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:08:47.053043 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b9fd3ac9-e429-4a3b-8ddd-96873fae8192 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:47.054099 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b9fd3ac9-e429-4a3b-8ddd-96873fae8192 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:47.061007 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b9fd3ac9-e429-4a3b-8ddd-96873fae8192 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:47.061458 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b9fd3ac9-e429-4a3b-8ddd-96873fae8192 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:47.062237 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b9fd3ac9-e429-4a3b-8ddd-96873fae8192 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:47.062676 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b9fd3ac9-e429-4a3b-8ddd-96873fae8192 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:47.153094 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b9fd3ac9-e429-4a3b-8ddd-96873fae8192 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action" status: 200 len: 18030 microversion: 2.20 time: 0.104164 Nov 16 16:08:47.153836 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 375/718] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:08:47 2021] POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action => generated 18030 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:08:47.202201 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-204aab8f-2bab-4ab6-b34c-3c4ad0937b9c tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:47.202820 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-204aab8f-2bab-4ab6-b34c-3c4ad0937b9c tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:47.209822 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-204aab8f-2bab-4ab6-b34c-3c4ad0937b9c tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:47.210267 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-204aab8f-2bab-4ab6-b34c-3c4ad0937b9c tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:47.211071 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-204aab8f-2bab-4ab6-b34c-3c4ad0937b9c tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:47.211536 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-204aab8f-2bab-4ab6-b34c-3c4ad0937b9c tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:47.412301 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c424cb75-db50-4a67-9fb9-7e9e4bcfc1b9 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:47.412995 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c424cb75-db50-4a67-9fb9-7e9e4bcfc1b9 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: db94bd78-8ff3-4784-84bd-e09796f6633a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:47.419798 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c424cb75-db50-4a67-9fb9-7e9e4bcfc1b9 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:47.420253 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c424cb75-db50-4a67-9fb9-7e9e4bcfc1b9 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:47.421036 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c424cb75-db50-4a67-9fb9-7e9e4bcfc1b9 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:47.421474 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c424cb75-db50-4a67-9fb9-7e9e4bcfc1b9 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:47.435386 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-c424cb75-db50-4a67-9fb9-7e9e4bcfc1b9 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] HTTP exception thrown: Instance db94bd78-8ff3-4784-84bd-e09796f6633a could not be found. Nov 16 16:08:47.436035 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c424cb75-db50-4a67-9fb9-7e9e4bcfc1b9 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Returning 404 to user: Instance db94bd78-8ff3-4784-84bd-e09796f6633a could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:08:47.436864 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c424cb75-db50-4a67-9fb9-7e9e4bcfc1b9 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a" status: 404 len: 111 microversion: 2.1 time: 0.028726 Nov 16 16:08:47.437424 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 376/719] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:47 2021] GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 16 16:08:47.485581 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-204aab8f-2bab-4ab6-b34c-3c4ad0937b9c tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a73e3dbb5a4da5976643ad8224f56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ed7321198471eb4645081b697d234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:47.493797 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-204aab8f-2bab-4ab6-b34c-3c4ad0937b9c tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d" status: 200 len: 1756 microversion: 2.1 time: 0.295237 Nov 16 16:08:47.494363 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 344/720] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:47 2021] GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d => generated 1756 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:08:47.530685 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e8aa0877-eb5c-4f8e-b86a-c69c54c96078 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1463444832", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1166381435", "security_groups": [{"name": "tempest-secgroup-smoke-1125201303"}], "block_device_mapping_v2": [{"uuid": "72d6c230-f6e4-4686-8a34-aa6f6c77a911", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d76e01f2-cefd-4113-8b4c-ae0a7cc24037"}]}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:47.618970 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-071cb199-6376-4721-a204-8af87c5f27a1 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:47.619511 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-071cb199-6376-4721-a204-8af87c5f27a1 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] [instance: 8be6d15b-4901-4b1b-9d39-97378569d908] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:47.625224 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-071cb199-6376-4721-a204-8af87c5f27a1 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:47.625671 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-071cb199-6376-4721-a204-8af87c5f27a1 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:47.626439 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-071cb199-6376-4721-a204-8af87c5f27a1 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:47.626870 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-071cb199-6376-4721-a204-8af87c5f27a1 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:47.640555 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.network.neutron [None req-e8aa0877-eb5c-4f8e-b86a-c69c54c96078 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] validate_networks() for [('d76e01f2-cefd-4113-8b4c-ae0a7cc24037', None, None, None, None, None)] {{(pid=116084) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 16:08:47.872758 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-071cb199-6376-4721-a204-8af87c5f27a1 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fcb8d8c3d490e915fe9583f70cb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bf6ebc44c444e911ba343e1c14785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:47.880874 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-071cb199-6376-4721-a204-8af87c5f27a1 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] 10.222.0.46 "GET /compute/v2.1/servers/8be6d15b-4901-4b1b-9d39-97378569d908" status: 200 len: 1514 microversion: 2.1 time: 0.265622 Nov 16 16:08:47.881448 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 345/721] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:47 2021] GET /compute/v2.1/servers/8be6d15b-4901-4b1b-9d39-97378569d908 => generated 1514 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:08:48.077324 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-e8aa0877-eb5c-4f8e-b86a-c69c54c96078 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Flavor limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 16:08:48.077820 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-e8aa0877-eb5c-4f8e-b86a-c69c54c96078 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Image limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 16:08:48.078208 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-e8aa0877-eb5c-4f8e-b86a-c69c54c96078 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Flavor pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 16:08:48.078616 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-e8aa0877-eb5c-4f8e-b86a-c69c54c96078 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Image pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 16:08:48.079028 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-e8aa0877-eb5c-4f8e-b86a-c69c54c96078 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 16:08:48.087679 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e8aa0877-eb5c-4f8e-b86a-c69c54c96078 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:48.088290 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e8aa0877-eb5c-4f8e-b86a-c69c54c96078 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:48.089100 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e8aa0877-eb5c-4f8e-b86a-c69c54c96078 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:48.089536 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e8aa0877-eb5c-4f8e-b86a-c69c54c96078 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:48.105605 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-e8aa0877-eb5c-4f8e-b86a-c69c54c96078 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Getting quotas for project d2bdf7025cb744f088b95cb0bba5169b. Resources: {'instances', 'ram', 'cores'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:08:48.109438 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-e8aa0877-eb5c-4f8e-b86a-c69c54c96078 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Getting quotas for user d363b1ed870843a6ba751e0d1ea0bd1e and project d2bdf7025cb744f088b95cb0bba5169b. Resources: {'instances', 'ram', 'cores'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:08:48.165353 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-07cec78a-6800-462c-a78a-d0bb3eaba562 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:48.166110 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-07cec78a-6800-462c-a78a-d0bb3eaba562 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:48.167407 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e8aa0877-eb5c-4f8e-b86a-c69c54c96078 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Going to run 1 instances... {{(pid=116084) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 16:08:48.169601 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e8aa0877-eb5c-4f8e-b86a-c69c54c96078 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: 9bc90f3f-4249-42b0-b344-cb67784082db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='72d6c230-f6e4-4686-8a34-aa6f6c77a911',volume_size=None,volume_type=None)] {{(pid=116084) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 16:08:48.171971 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-07cec78a-6800-462c-a78a-d0bb3eaba562 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:48.172455 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-07cec78a-6800-462c-a78a-d0bb3eaba562 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:48.173222 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-07cec78a-6800-462c-a78a-d0bb3eaba562 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:48.173658 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-07cec78a-6800-462c-a78a-d0bb3eaba562 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:48.255131 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-07cec78a-6800-462c-a78a-d0bb3eaba562 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action" status: 200 len: 19342 microversion: 2.20 time: 0.093349 Nov 16 16:08:48.256154 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 346/722] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:08:48 2021] POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action => generated 19342 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:08:48.290796 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e8aa0877-eb5c-4f8e-b86a-c69c54c96078 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.763982 Nov 16 16:08:48.291442 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 377/723] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 16 16:08:47 2021] POST /compute/v2.1/servers => generated 406 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 16:08:48.302301 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-717b370b-f413-4071-a7d1-8d177977c0d0 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:48.303002 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-717b370b-f413-4071-a7d1-8d177977c0d0 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: 9bc90f3f-4249-42b0-b344-cb67784082db] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:48.356579 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-717b370b-f413-4071-a7d1-8d177977c0d0 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:48.364429 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-717b370b-f413-4071-a7d1-8d177977c0d0 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/9bc90f3f-4249-42b0-b344-cb67784082db" status: 200 len: 1095 microversion: 2.1 time: 0.066752 Nov 16 16:08:48.365038 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 347/724] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:48 2021] GET /compute/v2.1/servers/9bc90f3f-4249-42b0-b344-cb67784082db => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:08:48.511960 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-521a3868-5df2-490e-96df-81b9a0c226b3 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:48.512570 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-521a3868-5df2-490e-96df-81b9a0c226b3 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:48.518620 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-521a3868-5df2-490e-96df-81b9a0c226b3 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:48.519663 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-521a3868-5df2-490e-96df-81b9a0c226b3 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:48.520629 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-521a3868-5df2-490e-96df-81b9a0c226b3 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:48.521063 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-521a3868-5df2-490e-96df-81b9a0c226b3 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:48.788532 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-521a3868-5df2-490e-96df-81b9a0c226b3 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a73e3dbb5a4da5976643ad8224f56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ed7321198471eb4645081b697d234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:48.797456 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-521a3868-5df2-490e-96df-81b9a0c226b3 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d" status: 200 len: 1756 microversion: 2.1 time: 0.289282 Nov 16 16:08:48.798237 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 378/725] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:48 2021] GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d => generated 1756 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:08:48.897948 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-faeed155-0d07-43f0-84b2-b539fd361674 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:48.898927 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-faeed155-0d07-43f0-84b2-b539fd361674 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] [instance: 8be6d15b-4901-4b1b-9d39-97378569d908] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:48.905816 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-faeed155-0d07-43f0-84b2-b539fd361674 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:48.906427 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-faeed155-0d07-43f0-84b2-b539fd361674 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:48.907108 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-faeed155-0d07-43f0-84b2-b539fd361674 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:48.907577 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-faeed155-0d07-43f0-84b2-b539fd361674 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:48.979786 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-b1d23b44-794c-4bb6-b3ae-635034521129 req-13cd1c89-87f2-40dd-ae24-27eda7464e4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8be6d15b-4901-4b1b-9d39-97378569d908", "name": "network-vif-deleted", "tag": "13e8233d-0121-4d55-835b-81b428667917"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:48.981757 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:08:48.981757 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Nov 16 16:08:48.989807 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-b1d23b44-794c-4bb6-b3ae-635034521129 req-13cd1c89-87f2-40dd-ae24-27eda7464e4a service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:48.989807 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-b1d23b44-794c-4bb6-b3ae-635034521129 req-13cd1c89-87f2-40dd-ae24-27eda7464e4a service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:48.994887 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-faeed155-0d07-43f0-84b2-b539fd361674 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c4fcb8d8c3d490e915fe9583f70cb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '218bf6ebc44c444e911ba343e1c14785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:49.004014 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-faeed155-0d07-43f0-84b2-b539fd361674 tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] 10.222.0.46 "GET /compute/v2.1/servers/8be6d15b-4901-4b1b-9d39-97378569d908" status: 200 len: 1472 microversion: 2.1 time: 0.110065 Nov 16 16:08:49.004722 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-b1d23b44-794c-4bb6-b3ae-635034521129 req-13cd1c89-87f2-40dd-ae24-27eda7464e4a service nova] Creating event network-vif-deleted:13e8233d-0121-4d55-835b-81b428667917 for instance 8be6d15b-4901-4b1b-9d39-97378569d908 on hv-cinder-81809 Nov 16 16:08:49.009692 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-b1d23b44-794c-4bb6-b3ae-635034521129 req-13cd1c89-87f2-40dd-ae24-27eda7464e4a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033832 Nov 16 16:08:49.010288 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 379/726] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:08:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:08:49.014201 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 348/727] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:48 2021] GET /compute/v2.1/servers/8be6d15b-4901-4b1b-9d39-97378569d908 => generated 1472 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:08:49.267808 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-076e607a-eb78-4503-a92a-e834965516a7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:49.268679 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-076e607a-eb78-4503-a92a-e834965516a7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:49.275841 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-076e607a-eb78-4503-a92a-e834965516a7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:49.276561 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-076e607a-eb78-4503-a92a-e834965516a7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:49.277346 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-076e607a-eb78-4503-a92a-e834965516a7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:49.277781 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-076e607a-eb78-4503-a92a-e834965516a7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:49.352827 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-076e607a-eb78-4503-a92a-e834965516a7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action" status: 200 len: 21840 microversion: 2.20 time: 0.089025 Nov 16 16:08:49.353632 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 380/728] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:08:49 2021] POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action => generated 21840 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 16 16:08:49.382047 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-dd7b46c8-421a-446b-acc6-72f3f3f0b3fc tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:49.383031 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-dd7b46c8-421a-446b-acc6-72f3f3f0b3fc tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: 9bc90f3f-4249-42b0-b344-cb67784082db] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:49.389333 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-dd7b46c8-421a-446b-acc6-72f3f3f0b3fc tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:49.389786 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-dd7b46c8-421a-446b-acc6-72f3f3f0b3fc tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:49.390581 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-dd7b46c8-421a-446b-acc6-72f3f3f0b3fc tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:49.391015 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-dd7b46c8-421a-446b-acc6-72f3f3f0b3fc tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:49.465676 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-dd7b46c8-421a-446b-acc6-72f3f3f0b3fc tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:49.474181 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-dd7b46c8-421a-446b-acc6-72f3f3f0b3fc tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/9bc90f3f-4249-42b0-b344-cb67784082db" status: 200 len: 1211 microversion: 2.1 time: 0.096464 Nov 16 16:08:49.484584 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 349/729] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:49 2021] GET /compute/v2.1/servers/9bc90f3f-4249-42b0-b344-cb67784082db => generated 1211 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:08:49.814592 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f6aaab7c-5542-483a-b5fe-2fb4a25baa8e tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:49.816141 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f6aaab7c-5542-483a-b5fe-2fb4a25baa8e tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:49.824062 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f6aaab7c-5542-483a-b5fe-2fb4a25baa8e tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:49.824670 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f6aaab7c-5542-483a-b5fe-2fb4a25baa8e tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:49.825513 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f6aaab7c-5542-483a-b5fe-2fb4a25baa8e tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:49.825903 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f6aaab7c-5542-483a-b5fe-2fb4a25baa8e tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:50.021017 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-0e3c7645-c554-408f-98fd-18b5124e243c tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:50.021824 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-0e3c7645-c554-408f-98fd-18b5124e243c tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] [instance: 8be6d15b-4901-4b1b-9d39-97378569d908] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:50.029450 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0e3c7645-c554-408f-98fd-18b5124e243c tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:50.029906 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0e3c7645-c554-408f-98fd-18b5124e243c tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:50.030775 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0e3c7645-c554-408f-98fd-18b5124e243c tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:50.031274 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0e3c7645-c554-408f-98fd-18b5124e243c tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:50.047373 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.wsgi [None req-0e3c7645-c554-408f-98fd-18b5124e243c tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] HTTP exception thrown: Instance 8be6d15b-4901-4b1b-9d39-97378569d908 could not be found. Nov 16 16:08:50.048762 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-0e3c7645-c554-408f-98fd-18b5124e243c tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] Returning 404 to user: Instance 8be6d15b-4901-4b1b-9d39-97378569d908 could not be found. {{(pid=116085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:08:50.049617 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-0e3c7645-c554-408f-98fd-18b5124e243c tempest-VolumesSnapshotTestJSON-1367004513 tempest-VolumesSnapshotTestJSON-1367004513-project] 10.222.0.46 "GET /compute/v2.1/servers/8be6d15b-4901-4b1b-9d39-97378569d908" status: 404 len: 111 microversion: 2.1 time: 0.032974 Nov 16 16:08:50.050210 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 350/730] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:50 2021] GET /compute/v2.1/servers/8be6d15b-4901-4b1b-9d39-97378569d908 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 16 16:08:50.087638 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-f9d8a570-c01e-4686-b127-d4b26b564a40 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:50.088622 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-f9d8a570-c01e-4686-b127-d4b26b564a40 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:50.094554 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f9d8a570-c01e-4686-b127-d4b26b564a40 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:50.095104 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f9d8a570-c01e-4686-b127-d4b26b564a40 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:50.095985 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f9d8a570-c01e-4686-b127-d4b26b564a40 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:50.096417 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f9d8a570-c01e-4686-b127-d4b26b564a40 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:50.127530 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-f9d8a570-c01e-4686-b127-d4b26b564a40 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044328 Nov 16 16:08:50.128546 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 351/731] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 16 16:08:50 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 16:08:50.186092 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-5b26d216-bb73-4ed1-9ed2-c41806689b17 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:50.187442 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-5b26d216-bb73-4ed1-9ed2-c41806689b17 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:50.196652 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5b26d216-bb73-4ed1-9ed2-c41806689b17 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:50.197616 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5b26d216-bb73-4ed1-9ed2-c41806689b17 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:50.198724 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5b26d216-bb73-4ed1-9ed2-c41806689b17 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:50.199289 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5b26d216-bb73-4ed1-9ed2-c41806689b17 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:50.226674 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-5b26d216-bb73-4ed1-9ed2-c41806689b17 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Going to try to terminate instance {{(pid=116085) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 16:08:50.318919 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f6aaab7c-5542-483a-b5fe-2fb4a25baa8e tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a73e3dbb5a4da5976643ad8224f56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ed7321198471eb4645081b697d234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:50.332813 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-5b26d216-bb73-4ed1-9ed2-c41806689b17 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "DELETE /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 204 len: 0 microversion: 2.1 time: 0.149973 Nov 16 16:08:50.334097 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 352/732] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 16 16:08:50 2021] DELETE /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 16 16:08:50.349218 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f6aaab7c-5542-483a-b5fe-2fb4a25baa8e tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d" status: 200 len: 1756 microversion: 2.1 time: 0.538743 Nov 16 16:08:50.352207 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 381/733] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:49 2021] GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d => generated 1756 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:08:50.355478 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-e5639905-66b5-460e-b7b0-c4badd08dc75 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:50.356386 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-e5639905-66b5-460e-b7b0-c4badd08dc75 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:50.363681 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e5639905-66b5-460e-b7b0-c4badd08dc75 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:50.364165 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e5639905-66b5-460e-b7b0-c4badd08dc75 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:50.365099 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e5639905-66b5-460e-b7b0-c4badd08dc75 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:50.365411 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e5639905-66b5-460e-b7b0-c4badd08dc75 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:50.367116 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-eae0045a-af9c-4730-838b-872ff6b496df tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:50.379933 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-eae0045a-af9c-4730-838b-872ff6b496df tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:50.388708 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-eae0045a-af9c-4730-838b-872ff6b496df tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:50.389483 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-eae0045a-af9c-4730-838b-872ff6b496df tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:50.390501 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-eae0045a-af9c-4730-838b-872ff6b496df tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:50.391181 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-eae0045a-af9c-4730-838b-872ff6b496df tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:50.475971 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-eae0045a-af9c-4730-838b-872ff6b496df tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action" status: 200 len: 23235 microversion: 2.20 time: 0.115365 Nov 16 16:08:50.477631 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 382/734] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:08:50 2021] POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action => generated 23235 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:08:50.494223 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a6469027-9dd6-42e3-8730-839ff6ad45c6 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:50.496081 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-a6469027-9dd6-42e3-8730-839ff6ad45c6 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: 9bc90f3f-4249-42b0-b344-cb67784082db] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:50.509868 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a6469027-9dd6-42e3-8730-839ff6ad45c6 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:50.510986 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a6469027-9dd6-42e3-8730-839ff6ad45c6 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:50.511890 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a6469027-9dd6-42e3-8730-839ff6ad45c6 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:50.512333 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a6469027-9dd6-42e3-8730-839ff6ad45c6 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:50.658382 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-e5639905-66b5-460e-b7b0-c4badd08dc75 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:50.667405 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-e5639905-66b5-460e-b7b0-c4badd08dc75 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1670 microversion: 2.1 time: 0.328479 Nov 16 16:08:50.668215 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 353/735] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:50 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1670 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:08:50.781229 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-a6469027-9dd6-42e3-8730-839ff6ad45c6 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:50.789952 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-a6469027-9dd6-42e3-8730-839ff6ad45c6 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/9bc90f3f-4249-42b0-b344-cb67784082db" status: 200 len: 1267 microversion: 2.1 time: 0.300041 Nov 16 16:08:50.790538 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 383/736] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:50 2021] GET /compute/v2.1/servers/9bc90f3f-4249-42b0-b344-cb67784082db => generated 1267 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:08:51.290232 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-bdcf0d2c-64c3-4978-98c3-8d3611f7fa3b req-712cf821-cde1-44cb-a764-8f5957fd4d58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bc90f3f-4249-42b0-b344-cb67784082db", "tag": "56ca6ce4-eb92-4ff7-876a-3215434b21af"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:51.291876 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:08:51.291876 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Nov 16 16:08:51.301303 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-bdcf0d2c-64c3-4978-98c3-8d3611f7fa3b req-712cf821-cde1-44cb-a764-8f5957fd4d58 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:51.302125 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-bdcf0d2c-64c3-4978-98c3-8d3611f7fa3b req-712cf821-cde1-44cb-a764-8f5957fd4d58 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:51.315058 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-bdcf0d2c-64c3-4978-98c3-8d3611f7fa3b req-712cf821-cde1-44cb-a764-8f5957fd4d58 service nova] Creating event network-changed:56ca6ce4-eb92-4ff7-876a-3215434b21af for instance 9bc90f3f-4249-42b0-b344-cb67784082db on hv-cinder-81809 Nov 16 16:08:51.322271 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-bdcf0d2c-64c3-4978-98c3-8d3611f7fa3b req-712cf821-cde1-44cb-a764-8f5957fd4d58 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036296 Nov 16 16:08:51.322984 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 354/737] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:08:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:08:51.371134 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f1325e4c-8357-427d-9747-d9db42b23f89 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:51.371955 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f1325e4c-8357-427d-9747-d9db42b23f89 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:51.379678 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f1325e4c-8357-427d-9747-d9db42b23f89 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:51.380345 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f1325e4c-8357-427d-9747-d9db42b23f89 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:51.381333 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f1325e4c-8357-427d-9747-d9db42b23f89 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:51.381922 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f1325e4c-8357-427d-9747-d9db42b23f89 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:51.493945 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-fef3b74e-a3ba-4f84-a917-956be7e69ef7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:51.497288 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-fef3b74e-a3ba-4f84-a917-956be7e69ef7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:51.504569 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fef3b74e-a3ba-4f84-a917-956be7e69ef7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:51.505159 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fef3b74e-a3ba-4f84-a917-956be7e69ef7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:51.506310 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fef3b74e-a3ba-4f84-a917-956be7e69ef7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:51.506814 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fef3b74e-a3ba-4f84-a917-956be7e69ef7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:51.582598 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-fef3b74e-a3ba-4f84-a917-956be7e69ef7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action" status: 200 len: 24493 microversion: 2.20 time: 0.096141 Nov 16 16:08:51.583777 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 355/738] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:08:51 2021] POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action => generated 24493 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:08:51.634327 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f1325e4c-8357-427d-9747-d9db42b23f89 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a73e3dbb5a4da5976643ad8224f56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ed7321198471eb4645081b697d234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:51.642388 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f1325e4c-8357-427d-9747-d9db42b23f89 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d" status: 200 len: 1756 microversion: 2.1 time: 0.276204 Nov 16 16:08:51.643442 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 384/739] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:51 2021] GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d => generated 1756 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:08:51.685609 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-2324b544-4ebf-4520-b8b6-145a944ded07 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:51.686312 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-2324b544-4ebf-4520-b8b6-145a944ded07 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:51.693940 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2324b544-4ebf-4520-b8b6-145a944ded07 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:51.694393 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2324b544-4ebf-4520-b8b6-145a944ded07 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:51.695181 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2324b544-4ebf-4520-b8b6-145a944ded07 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:51.695660 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2324b544-4ebf-4520-b8b6-145a944ded07 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:51.807284 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-2418ae9a-473f-4450-9741-d91441f90861 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:51.807824 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-2418ae9a-473f-4450-9741-d91441f90861 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: 9bc90f3f-4249-42b0-b344-cb67784082db] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:51.813512 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2418ae9a-473f-4450-9741-d91441f90861 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:51.813954 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2418ae9a-473f-4450-9741-d91441f90861 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:51.814721 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2418ae9a-473f-4450-9741-d91441f90861 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:51.815152 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2418ae9a-473f-4450-9741-d91441f90861 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:51.927546 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-2324b544-4ebf-4520-b8b6-145a944ded07 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:51.934982 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-2324b544-4ebf-4520-b8b6-145a944ded07 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1670 microversion: 2.1 time: 0.253484 Nov 16 16:08:51.935574 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 356/740] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:51 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1670 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:08:51.991342 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-2418ae9a-473f-4450-9741-d91441f90861 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:51.999106 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-2418ae9a-473f-4450-9741-d91441f90861 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/9bc90f3f-4249-42b0-b344-cb67784082db" status: 200 len: 1267 microversion: 2.1 time: 0.195545 Nov 16 16:08:51.999767 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 385/741] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:51 2021] GET /compute/v2.1/servers/9bc90f3f-4249-42b0-b344-cb67784082db => generated 1267 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:08:52.594003 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-e60bc9b6-d72b-4bd8-9638-efa3c5813456 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:52.594980 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-e60bc9b6-d72b-4bd8-9638-efa3c5813456 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:52.601809 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e60bc9b6-d72b-4bd8-9638-efa3c5813456 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:52.602260 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e60bc9b6-d72b-4bd8-9638-efa3c5813456 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:52.603111 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e60bc9b6-d72b-4bd8-9638-efa3c5813456 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:52.603485 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e60bc9b6-d72b-4bd8-9638-efa3c5813456 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:52.660580 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b4c164f9-97a3-4c1f-ac88-05ee572311bd tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:52.661739 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b4c164f9-97a3-4c1f-ac88-05ee572311bd tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:52.667518 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b4c164f9-97a3-4c1f-ac88-05ee572311bd tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:52.667963 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b4c164f9-97a3-4c1f-ac88-05ee572311bd tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:52.668728 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b4c164f9-97a3-4c1f-ac88-05ee572311bd tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:52.669157 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b4c164f9-97a3-4c1f-ac88-05ee572311bd tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:52.813333 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b4c164f9-97a3-4c1f-ac88-05ee572311bd tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a73e3dbb5a4da5976643ad8224f56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ed7321198471eb4645081b697d234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:52.821662 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b4c164f9-97a3-4c1f-ac88-05ee572311bd tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d" status: 200 len: 1756 microversion: 2.1 time: 0.164629 Nov 16 16:08:52.822229 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 386/742] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:52 2021] GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:08:52.951706 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-57712a5a-cd3e-4f4a-85cb-709a9f68d23a tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:52.952231 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-57712a5a-cd3e-4f4a-85cb-709a9f68d23a tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:52.959450 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-57712a5a-cd3e-4f4a-85cb-709a9f68d23a tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:52.959919 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-57712a5a-cd3e-4f4a-85cb-709a9f68d23a tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:52.960686 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-57712a5a-cd3e-4f4a-85cb-709a9f68d23a tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:52.961124 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-57712a5a-cd3e-4f4a-85cb-709a9f68d23a tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:53.096403 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-57712a5a-cd3e-4f4a-85cb-709a9f68d23a tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:53.103858 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-57712a5a-cd3e-4f4a-85cb-709a9f68d23a tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1670 microversion: 2.1 time: 0.155770 Nov 16 16:08:53.104427 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 387/743] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:52 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1670 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:08:53.108547 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6ccbc7ff-c9c3-4417-a0d4-1f5166dc3143 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:53.109146 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-6ccbc7ff-c9c3-4417-a0d4-1f5166dc3143 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: 9bc90f3f-4249-42b0-b344-cb67784082db] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:53.115323 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6ccbc7ff-c9c3-4417-a0d4-1f5166dc3143 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:53.115797 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6ccbc7ff-c9c3-4417-a0d4-1f5166dc3143 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:53.116580 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6ccbc7ff-c9c3-4417-a0d4-1f5166dc3143 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:53.117010 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6ccbc7ff-c9c3-4417-a0d4-1f5166dc3143 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:53.250336 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-6ccbc7ff-c9c3-4417-a0d4-1f5166dc3143 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:53.258481 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-6ccbc7ff-c9c3-4417-a0d4-1f5166dc3143 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/9bc90f3f-4249-42b0-b344-cb67784082db" status: 200 len: 1267 microversion: 2.1 time: 0.153121 Nov 16 16:08:53.259044 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 388/744] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:53 2021] GET /compute/v2.1/servers/9bc90f3f-4249-42b0-b344-cb67784082db => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:08:53.838038 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-5e859c24-a68e-44ab-839d-56156750caec tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:53.838737 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-5e859c24-a68e-44ab-839d-56156750caec tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:53.844626 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5e859c24-a68e-44ab-839d-56156750caec tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:53.845085 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5e859c24-a68e-44ab-839d-56156750caec tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:53.845861 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5e859c24-a68e-44ab-839d-56156750caec tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:53.846301 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5e859c24-a68e-44ab-839d-56156750caec tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:53.989778 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-5e859c24-a68e-44ab-839d-56156750caec tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a73e3dbb5a4da5976643ad8224f56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ed7321198471eb4645081b697d234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:53.997603 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-5e859c24-a68e-44ab-839d-56156750caec tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d" status: 200 len: 1756 microversion: 2.1 time: 0.163309 Nov 16 16:08:53.998176 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 389/745] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:53 2021] GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:08:54.120706 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d6cf0f7e-0a04-4565-8ce6-eea726b973f8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:54.121223 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d6cf0f7e-0a04-4565-8ce6-eea726b973f8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:54.127195 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d6cf0f7e-0a04-4565-8ce6-eea726b973f8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:54.127747 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d6cf0f7e-0a04-4565-8ce6-eea726b973f8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:54.128620 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d6cf0f7e-0a04-4565-8ce6-eea726b973f8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:54.129096 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d6cf0f7e-0a04-4565-8ce6-eea726b973f8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:54.256907 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d6cf0f7e-0a04-4565-8ce6-eea726b973f8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:54.264132 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d6cf0f7e-0a04-4565-8ce6-eea726b973f8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1670 microversion: 2.1 time: 0.147202 Nov 16 16:08:54.264697 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 390/746] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:54 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1670 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:08:54.275306 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-8dae127a-6ac6-4bd0-a7bc-506f5aedf09d tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:54.275931 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-8dae127a-6ac6-4bd0-a7bc-506f5aedf09d tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: 9bc90f3f-4249-42b0-b344-cb67784082db] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:54.281641 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8dae127a-6ac6-4bd0-a7bc-506f5aedf09d tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:54.282087 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8dae127a-6ac6-4bd0-a7bc-506f5aedf09d tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:54.282858 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8dae127a-6ac6-4bd0-a7bc-506f5aedf09d tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:54.283297 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8dae127a-6ac6-4bd0-a7bc-506f5aedf09d tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:54.422933 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-8dae127a-6ac6-4bd0-a7bc-506f5aedf09d tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:54.430295 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-8dae127a-6ac6-4bd0-a7bc-506f5aedf09d tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/9bc90f3f-4249-42b0-b344-cb67784082db" status: 200 len: 1267 microversion: 2.1 time: 0.158229 Nov 16 16:08:54.430868 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 391/747] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:54 2021] GET /compute/v2.1/servers/9bc90f3f-4249-42b0-b344-cb67784082db => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:08:54.531920 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-e60bc9b6-d72b-4bd8-9638-efa3c5813456 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action" status: 200 len: 27542 microversion: 2.20 time: 1.941297 Nov 16 16:08:54.532631 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 357/748] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:08:52 2021] POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action => generated 27542 bytes in 1943 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:08:55.024249 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c6a5c4a9-c843-4b8e-bebf-9e94cbe76048 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:55.037974 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c6a5c4a9-c843-4b8e-bebf-9e94cbe76048 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:55.037974 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c6a5c4a9-c843-4b8e-bebf-9e94cbe76048 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:55.037974 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c6a5c4a9-c843-4b8e-bebf-9e94cbe76048 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:55.037974 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c6a5c4a9-c843-4b8e-bebf-9e94cbe76048 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:55.038356 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c6a5c4a9-c843-4b8e-bebf-9e94cbe76048 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:55.187753 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-c6a5c4a9-c843-4b8e-bebf-9e94cbe76048 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a73e3dbb5a4da5976643ad8224f56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ed7321198471eb4645081b697d234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:55.195690 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c6a5c4a9-c843-4b8e-bebf-9e94cbe76048 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d" status: 200 len: 1756 microversion: 2.1 time: 0.182442 Nov 16 16:08:55.196257 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 392/749] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:55 2021] GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d => generated 1756 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:08:55.282080 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-58020e8a-9137-48ef-bc9e-8551a09822f5 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:55.282770 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-58020e8a-9137-48ef-bc9e-8551a09822f5 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:55.290250 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-58020e8a-9137-48ef-bc9e-8551a09822f5 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:55.290696 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-58020e8a-9137-48ef-bc9e-8551a09822f5 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:55.291503 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-58020e8a-9137-48ef-bc9e-8551a09822f5 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:55.291945 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-58020e8a-9137-48ef-bc9e-8551a09822f5 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:55.446639 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-5af25092-febc-47b1-bbed-bc0c872bb109 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:55.447151 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-5af25092-febc-47b1-bbed-bc0c872bb109 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: 9bc90f3f-4249-42b0-b344-cb67784082db] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:55.453092 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5af25092-febc-47b1-bbed-bc0c872bb109 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:55.453547 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5af25092-febc-47b1-bbed-bc0c872bb109 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:55.454345 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5af25092-febc-47b1-bbed-bc0c872bb109 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:55.454777 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5af25092-febc-47b1-bbed-bc0c872bb109 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:55.512965 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-58020e8a-9137-48ef-bc9e-8551a09822f5 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:55.520896 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-58020e8a-9137-48ef-bc9e-8551a09822f5 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1670 microversion: 2.1 time: 0.242316 Nov 16 16:08:55.521465 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 358/750] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:55 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1670 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:08:55.543595 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-2bee4ec0-0fdf-4461-9b27-9c7a88ee0746 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:55.544512 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-2bee4ec0-0fdf-4461-9b27-9c7a88ee0746 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:55.550225 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2bee4ec0-0fdf-4461-9b27-9c7a88ee0746 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:55.550671 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2bee4ec0-0fdf-4461-9b27-9c7a88ee0746 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:55.551988 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2bee4ec0-0fdf-4461-9b27-9c7a88ee0746 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:55.552426 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2bee4ec0-0fdf-4461-9b27-9c7a88ee0746 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:55.625138 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-2bee4ec0-0fdf-4461-9b27-9c7a88ee0746 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action" status: 200 len: 27780 microversion: 2.20 time: 0.084923 Nov 16 16:08:55.629083 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 359/751] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:08:55 2021] POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action => generated 27780 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 16 16:08:55.723649 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-5af25092-febc-47b1-bbed-bc0c872bb109 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:55.731949 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-5af25092-febc-47b1-bbed-bc0c872bb109 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/9bc90f3f-4249-42b0-b344-cb67784082db" status: 200 len: 1267 microversion: 2.1 time: 0.288878 Nov 16 16:08:55.732520 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 393/752] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:55 2021] GET /compute/v2.1/servers/9bc90f3f-4249-42b0-b344-cb67784082db => generated 1267 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:08:56.213745 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-ffbd560f-ba24-44f8-b0d7-89ac01731bc5 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:56.214361 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-ffbd560f-ba24-44f8-b0d7-89ac01731bc5 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:56.221360 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ffbd560f-ba24-44f8-b0d7-89ac01731bc5 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:56.221800 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ffbd560f-ba24-44f8-b0d7-89ac01731bc5 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:56.222569 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ffbd560f-ba24-44f8-b0d7-89ac01731bc5 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:56.223000 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ffbd560f-ba24-44f8-b0d7-89ac01731bc5 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:56.485351 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-ffbd560f-ba24-44f8-b0d7-89ac01731bc5 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a73e3dbb5a4da5976643ad8224f56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ed7321198471eb4645081b697d234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:56.494271 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-ffbd560f-ba24-44f8-b0d7-89ac01731bc5 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d" status: 200 len: 1759 microversion: 2.1 time: 0.284637 Nov 16 16:08:56.494858 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 360/753] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:56 2021] GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d => generated 1759 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:08:56.539328 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e6eab6ee-03c4-482b-884c-c6c34c1745d4 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:56.540999 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e6eab6ee-03c4-482b-884c-c6c34c1745d4 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:56.547652 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e6eab6ee-03c4-482b-884c-c6c34c1745d4 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:56.548105 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e6eab6ee-03c4-482b-884c-c6c34c1745d4 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:56.548895 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e6eab6ee-03c4-482b-884c-c6c34c1745d4 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:56.549329 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e6eab6ee-03c4-482b-884c-c6c34c1745d4 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:56.568037 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-252fa6c8-f2f2-4e99-ad56-0ca0375b2fe1 req-9587b6a0-a23a-488a-bc6d-d2e3d159b32e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "674c9e04-e56c-4891-adc1-7cdac0c8510f", "name": "network-vif-deleted", "tag": "07aae0fa-265c-47a8-af4f-ea385dbee127"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:56.569625 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:08:56.569625 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Nov 16 16:08:56.577103 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-252fa6c8-f2f2-4e99-ad56-0ca0375b2fe1 req-9587b6a0-a23a-488a-bc6d-d2e3d159b32e service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:56.577560 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-252fa6c8-f2f2-4e99-ad56-0ca0375b2fe1 req-9587b6a0-a23a-488a-bc6d-d2e3d159b32e service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:56.592642 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-252fa6c8-f2f2-4e99-ad56-0ca0375b2fe1 req-9587b6a0-a23a-488a-bc6d-d2e3d159b32e service nova] Creating event network-vif-deleted:07aae0fa-265c-47a8-af4f-ea385dbee127 for instance 674c9e04-e56c-4891-adc1-7cdac0c8510f on hv-cinder-81809 Nov 16 16:08:56.597723 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-252fa6c8-f2f2-4e99-ad56-0ca0375b2fe1 req-9587b6a0-a23a-488a-bc6d-d2e3d159b32e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033706 Nov 16 16:08:56.599083 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 361/754] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:08:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:08:56.623157 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e6eab6ee-03c4-482b-884c-c6c34c1745d4 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:56.633707 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e6eab6ee-03c4-482b-884c-c6c34c1745d4 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 200 len: 1602 microversion: 2.1 time: 0.099274 Nov 16 16:08:56.634537 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 394/755] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:56 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 1602 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:08:56.638076 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-a269d63d-bb67-4764-8c87-1348be2cf96f tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:56.639065 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-a269d63d-bb67-4764-8c87-1348be2cf96f tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:56.650041 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a269d63d-bb67-4764-8c87-1348be2cf96f tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:56.650552 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a269d63d-bb67-4764-8c87-1348be2cf96f tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:56.652330 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a269d63d-bb67-4764-8c87-1348be2cf96f tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:56.652944 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a269d63d-bb67-4764-8c87-1348be2cf96f tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:56.735873 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-a269d63d-bb67-4764-8c87-1348be2cf96f tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action" status: 200 len: 28203 microversion: 2.20 time: 0.101534 Nov 16 16:08:56.740376 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 362/756] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:08:56 2021] POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action => generated 28203 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 16 16:08:56.749309 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b8ae54e9-526f-437b-8ee7-25536b94b7b9 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:56.749913 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b8ae54e9-526f-437b-8ee7-25536b94b7b9 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: 9bc90f3f-4249-42b0-b344-cb67784082db] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:56.757303 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b8ae54e9-526f-437b-8ee7-25536b94b7b9 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:56.757684 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b8ae54e9-526f-437b-8ee7-25536b94b7b9 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:56.758463 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b8ae54e9-526f-437b-8ee7-25536b94b7b9 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:56.758894 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b8ae54e9-526f-437b-8ee7-25536b94b7b9 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:56.892002 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b8ae54e9-526f-437b-8ee7-25536b94b7b9 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:56.899379 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b8ae54e9-526f-437b-8ee7-25536b94b7b9 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/9bc90f3f-4249-42b0-b344-cb67784082db" status: 200 len: 1267 microversion: 2.1 time: 0.153730 Nov 16 16:08:56.899995 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 395/757] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:56 2021] GET /compute/v2.1/servers/9bc90f3f-4249-42b0-b344-cb67784082db => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:08:57.652626 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-8d022b4a-06a7-4911-a5ef-ad3e2a2d0bbb tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:57.653317 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-8d022b4a-06a7-4911-a5ef-ad3e2a2d0bbb tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:57.660146 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8d022b4a-06a7-4911-a5ef-ad3e2a2d0bbb tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:57.661231 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8d022b4a-06a7-4911-a5ef-ad3e2a2d0bbb tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:57.662186 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8d022b4a-06a7-4911-a5ef-ad3e2a2d0bbb tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:57.662619 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8d022b4a-06a7-4911-a5ef-ad3e2a2d0bbb tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:57.678049 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.wsgi [None req-8d022b4a-06a7-4911-a5ef-ad3e2a2d0bbb tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] HTTP exception thrown: Instance 674c9e04-e56c-4891-adc1-7cdac0c8510f could not be found. Nov 16 16:08:57.678640 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-8d022b4a-06a7-4911-a5ef-ad3e2a2d0bbb tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Returning 404 to user: Instance 674c9e04-e56c-4891-adc1-7cdac0c8510f could not be found. {{(pid=116085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:08:57.679477 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-8d022b4a-06a7-4911-a5ef-ad3e2a2d0bbb tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 404 len: 111 microversion: 2.1 time: 0.031373 Nov 16 16:08:57.680037 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 363/758] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:57 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:08:57.688561 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-8ca82578-9d55-4ded-bad5-dd08e31589b7 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '.version_select at 0x7f113c6e3f70>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:57.706684 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-8ca82578-9d55-4ded-bad5-dd08e31589b7 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-375028814" status: 202 len: 0 microversion: 2.1 time: 0.021897 Nov 16 16:08:57.707252 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 396/759] 10.222.0.46 () {58 vars in 1217 bytes} [Tue Nov 16 16:08:57 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-375028814 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:08:57.748077 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-d77e3da7-b27e-4e8c-bf92-1f1d1568c410 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:57.749295 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-d77e3da7-b27e-4e8c-bf92-1f1d1568c410 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:57.759156 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d77e3da7-b27e-4e8c-bf92-1f1d1568c410 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:57.759914 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d77e3da7-b27e-4e8c-bf92-1f1d1568c410 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:57.760971 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d77e3da7-b27e-4e8c-bf92-1f1d1568c410 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:57.761575 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d77e3da7-b27e-4e8c-bf92-1f1d1568c410 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:57.827592 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-d77e3da7-b27e-4e8c-bf92-1f1d1568c410 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action" status: 200 len: 28203 microversion: 2.20 time: 0.082525 Nov 16 16:08:57.828657 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 364/760] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:08:57 2021] POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action => generated 28203 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:08:57.921793 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-dbc57322-1dcf-4420-80b8-e474ad522eb6 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:57.922440 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-dbc57322-1dcf-4420-80b8-e474ad522eb6 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: 9bc90f3f-4249-42b0-b344-cb67784082db] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:57.930540 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dbc57322-1dcf-4420-80b8-e474ad522eb6 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:57.930997 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dbc57322-1dcf-4420-80b8-e474ad522eb6 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:57.932428 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dbc57322-1dcf-4420-80b8-e474ad522eb6 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:57.932865 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dbc57322-1dcf-4420-80b8-e474ad522eb6 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:58.142586 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-dbc57322-1dcf-4420-80b8-e474ad522eb6 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:58.151091 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-dbc57322-1dcf-4420-80b8-e474ad522eb6 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/9bc90f3f-4249-42b0-b344-cb67784082db" status: 200 len: 1267 microversion: 2.1 time: 0.237095 Nov 16 16:08:58.152060 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 397/761] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:57 2021] GET /compute/v2.1/servers/9bc90f3f-4249-42b0-b344-cb67784082db => generated 1267 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:08:58.468734 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-213b5547-b710-4430-b083-211976e03a61 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'create', calling method: .version_select at 0x7f113c28f040>, body: {"keypair": {"name": "tempest-keypair-1913773243"}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:58.483963 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-213b5547-b710-4430-b083-211976e03a61 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Getting quotas for project b827321a45f5478a8bd7953ed7be64b6. Resources: {'key_pairs'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:08:58.487943 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-213b5547-b710-4430-b083-211976e03a61 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Getting quotas for user d2b32db732d2490986e5b70a861de30c and project b827321a45f5478a8bd7953ed7be64b6. Resources: {'key_pairs'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:08:58.575083 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-213b5547-b710-4430-b083-211976e03a61 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Getting quotas for project b827321a45f5478a8bd7953ed7be64b6. Resources: {'key_pairs'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:08:58.578708 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-213b5547-b710-4430-b083-211976e03a61 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Getting quotas for user d2b32db732d2490986e5b70a861de30c and project b827321a45f5478a8bd7953ed7be64b6. Resources: {'key_pairs'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:08:58.593253 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-213b5547-b710-4430-b083-211976e03a61 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.128430 Nov 16 16:08:58.593854 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 365/762] 10.222.0.46 () {60 vars in 1157 bytes} [Tue Nov 16 16:08:58 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:08:58.840550 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-669b450d-6ce4-4a6c-8294-b76c5fc68ac4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:58.841485 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-669b450d-6ce4-4a6c-8294-b76c5fc68ac4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:58.848916 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-669b450d-6ce4-4a6c-8294-b76c5fc68ac4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:58.849504 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-669b450d-6ce4-4a6c-8294-b76c5fc68ac4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:58.850441 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-669b450d-6ce4-4a6c-8294-b76c5fc68ac4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:58.851011 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-669b450d-6ce4-4a6c-8294-b76c5fc68ac4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:59.169470 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-5c6217fa-8142-484a-852c-cf4e557f0ad5 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:59.170333 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-5c6217fa-8142-484a-852c-cf4e557f0ad5 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: 9bc90f3f-4249-42b0-b344-cb67784082db] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:08:59.177772 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5c6217fa-8142-484a-852c-cf4e557f0ad5 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:59.178769 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5c6217fa-8142-484a-852c-cf4e557f0ad5 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:59.179616 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5c6217fa-8142-484a-852c-cf4e557f0ad5 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:08:59.180052 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5c6217fa-8142-484a-852c-cf4e557f0ad5 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:08:59.318221 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-5c6217fa-8142-484a-852c-cf4e557f0ad5 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:08:59.325931 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-5c6217fa-8142-484a-852c-cf4e557f0ad5 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/9bc90f3f-4249-42b0-b344-cb67784082db" status: 200 len: 1267 microversion: 2.1 time: 0.160647 Nov 16 16:08:59.326494 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 366/763] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:08:59 2021] GET /compute/v2.1/servers/9bc90f3f-4249-42b0-b344-cb67784082db => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:08:59.853215 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-812b81d5-e3e4-4947-978b-56b244f24eef tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-175236696", "imageRef": "7c3bd8e0-8d7e-4cf7-90db-742c4f55e405", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ac91b040-5fe3-4eda-b0f1-4bb52cb28b8f"}], "security_groups": [{"name": "tempest-securitygroup--1569302128"}], "key_name": "tempest-keypair-1913773243", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:59.952771 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.network.neutron [None req-812b81d5-e3e4-4947-978b-56b244f24eef tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] validate_networks() for [('ac91b040-5fe3-4eda-b0f1-4bb52cb28b8f', None, None, None, None, None)] {{(pid=116085) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 16:09:00.327195 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-812b81d5-e3e4-4947-978b-56b244f24eef tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Flavor limits 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 16:09:00.327813 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-812b81d5-e3e4-4947-978b-56b244f24eef tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Image limits 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 16:09:00.328106 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-812b81d5-e3e4-4947-978b-56b244f24eef tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Flavor pref 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 16:09:00.328511 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-812b81d5-e3e4-4947-978b-56b244f24eef tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Image pref 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 16:09:00.328920 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-812b81d5-e3e4-4947-978b-56b244f24eef tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 16:09:00.338202 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-812b81d5-e3e4-4947-978b-56b244f24eef tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:00.338458 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-812b81d5-e3e4-4947-978b-56b244f24eef tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:00.339264 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-812b81d5-e3e4-4947-978b-56b244f24eef tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:00.339728 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-812b81d5-e3e4-4947-978b-56b244f24eef tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:00.355514 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-812b81d5-e3e4-4947-978b-56b244f24eef tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Getting quotas for project b827321a45f5478a8bd7953ed7be64b6. Resources: {'instances', 'ram', 'cores'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:09:00.359343 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-812b81d5-e3e4-4947-978b-56b244f24eef tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Getting quotas for user d2b32db732d2490986e5b70a861de30c and project b827321a45f5478a8bd7953ed7be64b6. Resources: {'instances', 'ram', 'cores'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:09:00.370093 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-812b81d5-e3e4-4947-978b-56b244f24eef tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Going to run 1 instances... {{(pid=116085) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 16:09:00.373496 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-812b81d5-e3e4-4947-978b-56b244f24eef tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c3bd8e0-8d7e-4cf7-90db-742c4f55e405',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116085) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 16:09:00.424024 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-812b81d5-e3e4-4947-978b-56b244f24eef tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.574760 Nov 16 16:09:00.424671 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 367/764] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 16 16:08:59 2021] POST /compute/v2.1/servers => generated 402 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 16 16:09:00.429960 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-8700266c-fa6f-480d-9a8b-decf6f8ee129 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:00.430571 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-8700266c-fa6f-480d-9a8b-decf6f8ee129 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: 9bc90f3f-4249-42b0-b344-cb67784082db] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:00.436831 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8700266c-fa6f-480d-9a8b-decf6f8ee129 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:00.437274 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8700266c-fa6f-480d-9a8b-decf6f8ee129 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:00.438046 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8700266c-fa6f-480d-9a8b-decf6f8ee129 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:00.438485 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8700266c-fa6f-480d-9a8b-decf6f8ee129 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:00.577998 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-8700266c-fa6f-480d-9a8b-decf6f8ee129 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:00.585707 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-8700266c-fa6f-480d-9a8b-decf6f8ee129 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/9bc90f3f-4249-42b0-b344-cb67784082db" status: 200 len: 1267 microversion: 2.1 time: 0.159329 Nov 16 16:09:00.590615 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 368/765] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:09:00 2021] GET /compute/v2.1/servers/9bc90f3f-4249-42b0-b344-cb67784082db => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:09:00.590785 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-d0e4100e-23da-4b94-89c0-73fb1b8d7b2f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:00.591578 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-d0e4100e-23da-4b94-89c0-73fb1b8d7b2f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:00.642512 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-d0e4100e-23da-4b94-89c0-73fb1b8d7b2f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:00.649060 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-d0e4100e-23da-4b94-89c0-73fb1b8d7b2f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69" status: 200 len: 1237 microversion: 2.1 time: 0.061758 Nov 16 16:09:00.649619 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 369/766] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:09:00 2021] GET /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69 => generated 1237 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:09:01.602835 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-44d5f525-2455-47b6-a404-948506cb37a2 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:01.603555 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-44d5f525-2455-47b6-a404-948506cb37a2 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: 9bc90f3f-4249-42b0-b344-cb67784082db] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:01.609700 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-44d5f525-2455-47b6-a404-948506cb37a2 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:01.610136 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-44d5f525-2455-47b6-a404-948506cb37a2 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:01.610901 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-44d5f525-2455-47b6-a404-948506cb37a2 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:01.611324 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-44d5f525-2455-47b6-a404-948506cb37a2 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:01.754512 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-44d5f525-2455-47b6-a404-948506cb37a2 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:01.762280 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-44d5f525-2455-47b6-a404-948506cb37a2 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/9bc90f3f-4249-42b0-b344-cb67784082db" status: 200 len: 1267 microversion: 2.1 time: 0.163459 Nov 16 16:09:01.762862 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 370/767] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:09:01 2021] GET /compute/v2.1/servers/9bc90f3f-4249-42b0-b344-cb67784082db => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:09:01.767156 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-2b333b1a-2d79-41c9-95a8-2eddcfbacfda tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:01.768042 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-2b333b1a-2d79-41c9-95a8-2eddcfbacfda tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:01.772213 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-669b450d-6ce4-4a6c-8294-b76c5fc68ac4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action" status: 200 len: 28494 microversion: 2.20 time: 2.935150 Nov 16 16:09:01.773631 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 398/768] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:08:58 2021] POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action => generated 28494 bytes in 2937 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:09:01.774324 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2b333b1a-2d79-41c9-95a8-2eddcfbacfda tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:01.774956 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2b333b1a-2d79-41c9-95a8-2eddcfbacfda tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:01.775947 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2b333b1a-2d79-41c9-95a8-2eddcfbacfda tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:01.776802 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2b333b1a-2d79-41c9-95a8-2eddcfbacfda tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:01.853380 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-2b333b1a-2d79-41c9-95a8-2eddcfbacfda tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:01.860804 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-2b333b1a-2d79-41c9-95a8-2eddcfbacfda tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69" status: 200 len: 1241 microversion: 2.1 time: 0.096974 Nov 16 16:09:01.861745 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 371/769] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:09:01 2021] GET /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69 => generated 1241 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:09:02.779971 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-56fb10ca-daff-4392-93ce-55d8a515ec86 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:02.780683 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-56fb10ca-daff-4392-93ce-55d8a515ec86 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: 9bc90f3f-4249-42b0-b344-cb67784082db] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:02.783523 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-b2767d79-5f57-438b-8958-2d07e3e6d46a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:02.784483 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-b2767d79-5f57-438b-8958-2d07e3e6d46a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:02.790671 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-56fb10ca-daff-4392-93ce-55d8a515ec86 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:02.791419 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-56fb10ca-daff-4392-93ce-55d8a515ec86 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:02.791760 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b2767d79-5f57-438b-8958-2d07e3e6d46a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:02.792212 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b2767d79-5f57-438b-8958-2d07e3e6d46a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:02.792548 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-56fb10ca-daff-4392-93ce-55d8a515ec86 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:02.792995 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b2767d79-5f57-438b-8958-2d07e3e6d46a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:02.793200 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-56fb10ca-daff-4392-93ce-55d8a515ec86 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:02.793430 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b2767d79-5f57-438b-8958-2d07e3e6d46a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:02.884054 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-b2767d79-5f57-438b-8958-2d07e3e6d46a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action" status: 200 len: 28662 microversion: 2.20 time: 0.103612 Nov 16 16:09:02.890010 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 372/770] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:09:02 2021] POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action => generated 28662 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 16 16:09:02.896931 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-0368e1ef-9dc7-4f99-b737-2335403f3b75 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:02.897729 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-0368e1ef-9dc7-4f99-b737-2335403f3b75 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:02.905891 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0368e1ef-9dc7-4f99-b737-2335403f3b75 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:02.906414 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0368e1ef-9dc7-4f99-b737-2335403f3b75 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:02.907280 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0368e1ef-9dc7-4f99-b737-2335403f3b75 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:02.907853 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0368e1ef-9dc7-4f99-b737-2335403f3b75 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:03.008849 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-0368e1ef-9dc7-4f99-b737-2335403f3b75 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:03.011450 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-56fb10ca-daff-4392-93ce-55d8a515ec86 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:03.017723 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-0368e1ef-9dc7-4f99-b737-2335403f3b75 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69" status: 200 len: 1295 microversion: 2.1 time: 0.126180 Nov 16 16:09:03.018525 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 373/771] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:09:02 2021] GET /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69 => generated 1295 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:09:03.028455 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-56fb10ca-daff-4392-93ce-55d8a515ec86 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/9bc90f3f-4249-42b0-b344-cb67784082db" status: 200 len: 1267 microversion: 2.1 time: 0.243146 Nov 16 16:09:03.029080 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 399/772] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:09:02 2021] GET /compute/v2.1/servers/9bc90f3f-4249-42b0-b344-cb67784082db => generated 1267 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:09:03.897323 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-f86286a4-29f5-4ea8-be00-60648239a2a6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:03.898286 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-f86286a4-29f5-4ea8-be00-60648239a2a6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:03.905013 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f86286a4-29f5-4ea8-be00-60648239a2a6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:03.905740 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f86286a4-29f5-4ea8-be00-60648239a2a6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:03.906534 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f86286a4-29f5-4ea8-be00-60648239a2a6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:03.906975 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f86286a4-29f5-4ea8-be00-60648239a2a6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:03.979121 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-f86286a4-29f5-4ea8-be00-60648239a2a6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action" status: 200 len: 28662 microversion: 2.20 time: 0.086428 Nov 16 16:09:03.980033 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 374/773] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:09:03 2021] POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action => generated 28662 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:09:04.030045 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-e020ba5d-585a-4416-9f35-cd9426a6ca41 req-5fca7232-e2bd-4b14-a1fc-0f72a1d74d5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6001444a-6dd4-41b0-b53f-eb0c1537cf69", "tag": "f73b554b-5d47-43fc-9731-138b41f213ad"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:04.032558 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:09:04.032558 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Nov 16 16:09:04.038281 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-4b93886d-3a4f-4f92-a24a-b515cadaccbf tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:04.039205 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-4b93886d-3a4f-4f92-a24a-b515cadaccbf tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:04.043567 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-e020ba5d-585a-4416-9f35-cd9426a6ca41 req-5fca7232-e2bd-4b14-a1fc-0f72a1d74d5a service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:04.044611 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-e020ba5d-585a-4416-9f35-cd9426a6ca41 req-5fca7232-e2bd-4b14-a1fc-0f72a1d74d5a service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:04.049012 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4b93886d-3a4f-4f92-a24a-b515cadaccbf tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:04.049478 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4b93886d-3a4f-4f92-a24a-b515cadaccbf tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:04.050375 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4b93886d-3a4f-4f92-a24a-b515cadaccbf tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:04.050852 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4b93886d-3a4f-4f92-a24a-b515cadaccbf tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:04.059696 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-e020ba5d-585a-4416-9f35-cd9426a6ca41 req-5fca7232-e2bd-4b14-a1fc-0f72a1d74d5a service nova] Creating event network-changed:f73b554b-5d47-43fc-9731-138b41f213ad for instance 6001444a-6dd4-41b0-b53f-eb0c1537cf69 on hv-cinder-81809 Nov 16 16:09:04.077233 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-e020ba5d-585a-4416-9f35-cd9426a6ca41 req-5fca7232-e2bd-4b14-a1fc-0f72a1d74d5a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054823 Nov 16 16:09:04.080556 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 400/774] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:09:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:09:04.089791 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-9998d939-f20a-43e0-a3ab-98fb7dcdd0f9 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:04.091295 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-9998d939-f20a-43e0-a3ab-98fb7dcdd0f9 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: 9bc90f3f-4249-42b0-b344-cb67784082db] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:04.099943 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9998d939-f20a-43e0-a3ab-98fb7dcdd0f9 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:04.100736 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9998d939-f20a-43e0-a3ab-98fb7dcdd0f9 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:04.101904 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9998d939-f20a-43e0-a3ab-98fb7dcdd0f9 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:04.102581 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9998d939-f20a-43e0-a3ab-98fb7dcdd0f9 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:04.313494 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-4b93886d-3a4f-4f92-a24a-b515cadaccbf tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:04.334625 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-4b93886d-3a4f-4f92-a24a-b515cadaccbf tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69" status: 200 len: 1363 microversion: 2.1 time: 0.294270 Nov 16 16:09:04.334625 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 375/775] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:09:04 2021] GET /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69 => generated 1363 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:09:04.350368 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-9998d939-f20a-43e0-a3ab-98fb7dcdd0f9 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:04.360153 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-9998d939-f20a-43e0-a3ab-98fb7dcdd0f9 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/9bc90f3f-4249-42b0-b344-cb67784082db" status: 200 len: 1267 microversion: 2.1 time: 0.277942 Nov 16 16:09:04.368072 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 401/776] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:09:04 2021] GET /compute/v2.1/servers/9bc90f3f-4249-42b0-b344-cb67784082db => generated 1267 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:09:05.054333 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-87780498-ef78-4db0-80c2-c3d33568d1cc tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:05.055387 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-87780498-ef78-4db0-80c2-c3d33568d1cc tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:05.063301 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-87780498-ef78-4db0-80c2-c3d33568d1cc tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:05.063774 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-87780498-ef78-4db0-80c2-c3d33568d1cc tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:05.064566 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-87780498-ef78-4db0-80c2-c3d33568d1cc tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:05.065000 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-87780498-ef78-4db0-80c2-c3d33568d1cc tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:05.134197 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-87780498-ef78-4db0-80c2-c3d33568d1cc tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action" status: 200 len: 28662 microversion: 2.20 time: 0.146527 Nov 16 16:09:05.134829 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 376/777] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:09:04 2021] POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action => generated 28662 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:09:05.377310 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-a216c539-d55e-4116-b68c-769c7e5ecc81 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:05.378008 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-a216c539-d55e-4116-b68c-769c7e5ecc81 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: 9bc90f3f-4249-42b0-b344-cb67784082db] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:05.384887 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a216c539-d55e-4116-b68c-769c7e5ecc81 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:05.385162 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a216c539-d55e-4116-b68c-769c7e5ecc81 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:05.385936 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a216c539-d55e-4116-b68c-769c7e5ecc81 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:05.386391 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a216c539-d55e-4116-b68c-769c7e5ecc81 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:05.400918 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3af25975-8a65-4eeb-a36e-99add383c55f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:05.401974 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-3af25975-8a65-4eeb-a36e-99add383c55f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:05.407802 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3af25975-8a65-4eeb-a36e-99add383c55f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:05.408320 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3af25975-8a65-4eeb-a36e-99add383c55f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:05.409157 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3af25975-8a65-4eeb-a36e-99add383c55f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:05.409657 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3af25975-8a65-4eeb-a36e-99add383c55f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:05.596221 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-a216c539-d55e-4116-b68c-769c7e5ecc81 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:05.604174 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-a216c539-d55e-4116-b68c-769c7e5ecc81 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/9bc90f3f-4249-42b0-b344-cb67784082db" status: 200 len: 1267 microversion: 2.1 time: 0.230783 Nov 16 16:09:05.604669 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 377/778] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:09:05 2021] GET /compute/v2.1/servers/9bc90f3f-4249-42b0-b344-cb67784082db => generated 1267 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:09:05.609103 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-3af25975-8a65-4eeb-a36e-99add383c55f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:05.617009 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-3af25975-8a65-4eeb-a36e-99add383c55f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69" status: 200 len: 1363 microversion: 2.1 time: 0.276285 Nov 16 16:09:05.617577 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 402/779] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:09:05 2021] GET /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69 => generated 1363 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:09:05.927862 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-3e2ff05e-c702-4058-aa57-0935bde52ee2 req-2a6bf4d4-5dc5-4e04-8f87-b940e8ca0809 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bc90f3f-4249-42b0-b344-cb67784082db", "name": "network-vif-plugged", "status": "completed", "tag": "56ca6ce4-eb92-4ff7-876a-3215434b21af"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:05.929457 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:09:05.929457 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Nov 16 16:09:05.937037 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-3e2ff05e-c702-4058-aa57-0935bde52ee2 req-2a6bf4d4-5dc5-4e04-8f87-b940e8ca0809 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:05.937587 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-3e2ff05e-c702-4058-aa57-0935bde52ee2 req-2a6bf4d4-5dc5-4e04-8f87-b940e8ca0809 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:05.951932 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-3e2ff05e-c702-4058-aa57-0935bde52ee2 req-2a6bf4d4-5dc5-4e04-8f87-b940e8ca0809 service nova] Creating event network-vif-plugged:56ca6ce4-eb92-4ff7-876a-3215434b21af for instance 9bc90f3f-4249-42b0-b344-cb67784082db on hv-cinder-81809 Nov 16 16:09:05.956641 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-3e2ff05e-c702-4058-aa57-0935bde52ee2 req-2a6bf4d4-5dc5-4e04-8f87-b940e8ca0809 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032976 Nov 16 16:09:05.958022 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 378/780] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:09:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:09:06.146604 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-45bc8400-f514-4b73-8d72-904899e98512 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:06.147530 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-45bc8400-f514-4b73-8d72-904899e98512 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:06.153833 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-45bc8400-f514-4b73-8d72-904899e98512 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:06.154280 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-45bc8400-f514-4b73-8d72-904899e98512 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:06.155062 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-45bc8400-f514-4b73-8d72-904899e98512 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:06.155525 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-45bc8400-f514-4b73-8d72-904899e98512 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:06.215984 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-45bc8400-f514-4b73-8d72-904899e98512 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action" status: 200 len: 28662 microversion: 2.20 time: 0.073692 Nov 16 16:09:06.219500 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 403/781] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:09:06 2021] POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action => generated 28662 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:09:06.620833 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-61240677-94df-439c-a980-187893046273 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:06.621531 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-61240677-94df-439c-a980-187893046273 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: 9bc90f3f-4249-42b0-b344-cb67784082db] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:06.627998 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-61240677-94df-439c-a980-187893046273 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:06.628444 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-61240677-94df-439c-a980-187893046273 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:06.629917 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-61240677-94df-439c-a980-187893046273 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:06.630378 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-61240677-94df-439c-a980-187893046273 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:06.635308 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-54d43840-1aa6-4acd-99d2-ed71279b4a5c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:06.636169 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-54d43840-1aa6-4acd-99d2-ed71279b4a5c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:06.642890 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-54d43840-1aa6-4acd-99d2-ed71279b4a5c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:06.643427 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-54d43840-1aa6-4acd-99d2-ed71279b4a5c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:06.644299 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-54d43840-1aa6-4acd-99d2-ed71279b4a5c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:06.646017 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-54d43840-1aa6-4acd-99d2-ed71279b4a5c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:06.824989 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-61240677-94df-439c-a980-187893046273 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:06.833052 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-61240677-94df-439c-a980-187893046273 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/9bc90f3f-4249-42b0-b344-cb67784082db" status: 200 len: 1267 microversion: 2.1 time: 0.215552 Nov 16 16:09:06.833634 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 379/782] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:09:06 2021] GET /compute/v2.1/servers/9bc90f3f-4249-42b0-b344-cb67784082db => generated 1267 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:09:06.848503 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-54d43840-1aa6-4acd-99d2-ed71279b4a5c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:06.855830 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-54d43840-1aa6-4acd-99d2-ed71279b4a5c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69" status: 200 len: 1363 microversion: 2.1 time: 0.224413 Nov 16 16:09:06.856335 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 404/783] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:09:06 2021] GET /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69 => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:09:07.227755 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-a9701495-e138-47ba-940b-c162725fe432 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:07.228600 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-a9701495-e138-47ba-940b-c162725fe432 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:07.234903 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a9701495-e138-47ba-940b-c162725fe432 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:07.235358 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a9701495-e138-47ba-940b-c162725fe432 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:07.236165 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a9701495-e138-47ba-940b-c162725fe432 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:07.236604 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a9701495-e138-47ba-940b-c162725fe432 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:07.333134 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-a9701495-e138-47ba-940b-c162725fe432 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action" status: 200 len: 29243 microversion: 2.20 time: 0.109013 Nov 16 16:09:07.334029 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 380/784] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:09:07 2021] POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action => generated 29243 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:09:07.850198 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-8152e17b-bbce-40d1-aff8-b6c3da41c31e tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:07.850803 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-8152e17b-bbce-40d1-aff8-b6c3da41c31e tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: 9bc90f3f-4249-42b0-b344-cb67784082db] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:07.856969 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8152e17b-bbce-40d1-aff8-b6c3da41c31e tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:07.857413 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8152e17b-bbce-40d1-aff8-b6c3da41c31e tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:07.858186 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8152e17b-bbce-40d1-aff8-b6c3da41c31e tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:07.858614 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8152e17b-bbce-40d1-aff8-b6c3da41c31e tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:07.874416 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-d6f057af-c736-4c4a-9789-2d3390d98380 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:07.875269 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-d6f057af-c736-4c4a-9789-2d3390d98380 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:07.883499 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d6f057af-c736-4c4a-9789-2d3390d98380 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:07.883967 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d6f057af-c736-4c4a-9789-2d3390d98380 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:07.884762 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d6f057af-c736-4c4a-9789-2d3390d98380 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:07.885199 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d6f057af-c736-4c4a-9789-2d3390d98380 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:08.074472 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-8152e17b-bbce-40d1-aff8-b6c3da41c31e tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:08.081727 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-8152e17b-bbce-40d1-aff8-b6c3da41c31e tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/9bc90f3f-4249-42b0-b344-cb67784082db" status: 200 len: 1453 microversion: 2.1 time: 0.235952 Nov 16 16:09:08.082408 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 405/785] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:09:07 2021] GET /compute/v2.1/servers/9bc90f3f-4249-42b0-b344-cb67784082db => generated 1453 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:09:08.089417 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-d6f057af-c736-4c4a-9789-2d3390d98380 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:08.097089 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-d6f057af-c736-4c4a-9789-2d3390d98380 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69" status: 200 len: 1363 microversion: 2.1 time: 0.226682 Nov 16 16:09:08.097906 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 381/786] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:09:07 2021] GET /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69 => generated 1363 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:09:08.098681 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b5a40535-226a-4446-9e7e-6c2c26a159aa tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:08.099299 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b5a40535-226a-4446-9e7e-6c2c26a159aa tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: 9bc90f3f-4249-42b0-b344-cb67784082db] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:08.105030 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b5a40535-226a-4446-9e7e-6c2c26a159aa tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:08.105475 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b5a40535-226a-4446-9e7e-6c2c26a159aa tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:08.106250 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b5a40535-226a-4446-9e7e-6c2c26a159aa tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:08.106676 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b5a40535-226a-4446-9e7e-6c2c26a159aa tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:08.249893 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b5a40535-226a-4446-9e7e-6c2c26a159aa tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:08.257401 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b5a40535-226a-4446-9e7e-6c2c26a159aa tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/9bc90f3f-4249-42b0-b344-cb67784082db" status: 200 len: 1453 microversion: 2.1 time: 0.163348 Nov 16 16:09:08.257973 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 406/787] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:09:08 2021] GET /compute/v2.1/servers/9bc90f3f-4249-42b0-b344-cb67784082db => generated 1453 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:09:08.346938 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-62492f4a-2bd8-4fb0-85ed-1ae07a9f6746 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:08.350042 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-62492f4a-2bd8-4fb0-85ed-1ae07a9f6746 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:08.356991 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-62492f4a-2bd8-4fb0-85ed-1ae07a9f6746 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:08.357438 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-62492f4a-2bd8-4fb0-85ed-1ae07a9f6746 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:08.358212 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-62492f4a-2bd8-4fb0-85ed-1ae07a9f6746 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:08.358637 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-62492f4a-2bd8-4fb0-85ed-1ae07a9f6746 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:08.438720 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-62492f4a-2bd8-4fb0-85ed-1ae07a9f6746 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action" status: 200 len: 30801 microversion: 2.20 time: 0.096823 Nov 16 16:09:08.443358 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 382/788] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:09:08 2021] POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action => generated 30801 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:09:09.113294 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-4dd58861-e321-4965-ae13-887c863de2ff tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:09.114638 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-4dd58861-e321-4965-ae13-887c863de2ff tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:09.121693 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4dd58861-e321-4965-ae13-887c863de2ff tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:09.122248 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4dd58861-e321-4965-ae13-887c863de2ff tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:09.123077 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4dd58861-e321-4965-ae13-887c863de2ff tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:09.123688 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4dd58861-e321-4965-ae13-887c863de2ff tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:09.264275 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-4dd58861-e321-4965-ae13-887c863de2ff tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:09.271564 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-4dd58861-e321-4965-ae13-887c863de2ff tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69" status: 200 len: 1363 microversion: 2.1 time: 0.161931 Nov 16 16:09:09.272138 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 407/789] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:09:09 2021] GET /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:09:09.450724 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-c4bf9a1a-79f4-4fa6-a19b-095964b7ba6a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:09.451863 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-c4bf9a1a-79f4-4fa6-a19b-095964b7ba6a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:09.459826 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c4bf9a1a-79f4-4fa6-a19b-095964b7ba6a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:09.460265 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c4bf9a1a-79f4-4fa6-a19b-095964b7ba6a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:09.461042 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c4bf9a1a-79f4-4fa6-a19b-095964b7ba6a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:09.461471 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c4bf9a1a-79f4-4fa6-a19b-095964b7ba6a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:09.549621 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-c4bf9a1a-79f4-4fa6-a19b-095964b7ba6a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action" status: 200 len: 32284 microversion: 2.20 time: 0.102867 Nov 16 16:09:09.550339 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 383/790] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:09:09 2021] POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action => generated 32284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:09:09.899913 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-e523fc04-e583-4b05-8bc7-c3a14b1fd3e9 req-90dc3401-86a6-49ad-abd7-cf6c766a394a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bc90f3f-4249-42b0-b344-cb67784082db", "tag": "56ca6ce4-eb92-4ff7-876a-3215434b21af"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:09.899913 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:09:09.899913 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Nov 16 16:09:09.907373 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-e523fc04-e583-4b05-8bc7-c3a14b1fd3e9 req-90dc3401-86a6-49ad-abd7-cf6c766a394a service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:09.907939 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-e523fc04-e583-4b05-8bc7-c3a14b1fd3e9 req-90dc3401-86a6-49ad-abd7-cf6c766a394a service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:09.919797 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-e523fc04-e583-4b05-8bc7-c3a14b1fd3e9 req-90dc3401-86a6-49ad-abd7-cf6c766a394a service nova] Creating event network-changed:56ca6ce4-eb92-4ff7-876a-3215434b21af for instance 9bc90f3f-4249-42b0-b344-cb67784082db on hv-cinder-81809 Nov 16 16:09:09.924817 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-e523fc04-e583-4b05-8bc7-c3a14b1fd3e9 req-90dc3401-86a6-49ad-abd7-cf6c766a394a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031957 Nov 16 16:09:09.925501 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 408/791] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:09:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:09:10.058059 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-08ed3209-1763-456c-af6a-db25835643ab req-08c4cadb-9107-4484-a337-51fdc9f1671b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6001444a-6dd4-41b0-b53f-eb0c1537cf69", "name": "network-vif-plugged", "status": "completed", "tag": "f73b554b-5d47-43fc-9731-138b41f213ad"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:10.062147 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:09:10.062147 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Nov 16 16:09:10.073291 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-08ed3209-1763-456c-af6a-db25835643ab req-08c4cadb-9107-4484-a337-51fdc9f1671b service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:10.073746 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-08ed3209-1763-456c-af6a-db25835643ab req-08c4cadb-9107-4484-a337-51fdc9f1671b service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:10.092830 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-08ed3209-1763-456c-af6a-db25835643ab req-08c4cadb-9107-4484-a337-51fdc9f1671b service nova] Creating event network-vif-plugged:f73b554b-5d47-43fc-9731-138b41f213ad for instance 6001444a-6dd4-41b0-b53f-eb0c1537cf69 on hv-cinder-81809 Nov 16 16:09:10.098622 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-08ed3209-1763-456c-af6a-db25835643ab req-08c4cadb-9107-4484-a337-51fdc9f1671b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049119 Nov 16 16:09:10.099732 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 384/792] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:09:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:09:10.292614 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-787bee02-76ba-4952-8dd8-fd6184aa2928 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:10.294112 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-787bee02-76ba-4952-8dd8-fd6184aa2928 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:10.301175 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-787bee02-76ba-4952-8dd8-fd6184aa2928 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:10.302045 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-787bee02-76ba-4952-8dd8-fd6184aa2928 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:10.302847 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-787bee02-76ba-4952-8dd8-fd6184aa2928 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:10.303429 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-787bee02-76ba-4952-8dd8-fd6184aa2928 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:10.506477 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-787bee02-76ba-4952-8dd8-fd6184aa2928 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:10.513638 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-787bee02-76ba-4952-8dd8-fd6184aa2928 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69" status: 200 len: 1363 microversion: 2.1 time: 0.228692 Nov 16 16:09:10.514219 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 409/793] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:09:10 2021] GET /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69 => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:09:10.562855 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-09588153-a4a2-49aa-b99d-5d77451e5356 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:10.563903 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-09588153-a4a2-49aa-b99d-5d77451e5356 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:10.569979 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-09588153-a4a2-49aa-b99d-5d77451e5356 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:10.570428 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-09588153-a4a2-49aa-b99d-5d77451e5356 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:10.571214 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-09588153-a4a2-49aa-b99d-5d77451e5356 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:10.571686 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-09588153-a4a2-49aa-b99d-5d77451e5356 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:10.735938 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-09588153-a4a2-49aa-b99d-5d77451e5356 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action" status: 200 len: 33450 microversion: 2.20 time: 0.177413 Nov 16 16:09:10.740165 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 385/794] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:09:10 2021] POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action => generated 33450 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:09:11.532294 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-8f1aa9b9-e99a-438a-bc1b-21fe2fcfa09e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:11.532911 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-8f1aa9b9-e99a-438a-bc1b-21fe2fcfa09e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:11.540512 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8f1aa9b9-e99a-438a-bc1b-21fe2fcfa09e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:11.540908 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8f1aa9b9-e99a-438a-bc1b-21fe2fcfa09e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:11.541693 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8f1aa9b9-e99a-438a-bc1b-21fe2fcfa09e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:11.542132 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8f1aa9b9-e99a-438a-bc1b-21fe2fcfa09e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:11.683267 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-8f1aa9b9-e99a-438a-bc1b-21fe2fcfa09e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:11.691167 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-8f1aa9b9-e99a-438a-bc1b-21fe2fcfa09e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69" status: 200 len: 1363 microversion: 2.1 time: 0.163709 Nov 16 16:09:11.692163 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 410/795] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:09:11 2021] GET /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:09:11.748323 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-860b6b2c-f964-4c6a-8edb-6288818b8abd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:11.749326 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-860b6b2c-f964-4c6a-8edb-6288818b8abd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:11.756470 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-860b6b2c-f964-4c6a-8edb-6288818b8abd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:11.756952 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-860b6b2c-f964-4c6a-8edb-6288818b8abd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:11.757726 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-860b6b2c-f964-4c6a-8edb-6288818b8abd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:11.758158 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-860b6b2c-f964-4c6a-8edb-6288818b8abd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:11.847615 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-860b6b2c-f964-4c6a-8edb-6288818b8abd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action" status: 200 len: 34102 microversion: 2.20 time: 0.102493 Nov 16 16:09:11.848857 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 386/796] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:09:11 2021] POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action => generated 34102 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:09:12.711095 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d61eb279-2692-4e89-a082-459632c1f094 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:12.712010 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d61eb279-2692-4e89-a082-459632c1f094 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:12.718637 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d61eb279-2692-4e89-a082-459632c1f094 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:12.719162 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d61eb279-2692-4e89-a082-459632c1f094 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:12.720555 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d61eb279-2692-4e89-a082-459632c1f094 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:12.721074 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d61eb279-2692-4e89-a082-459632c1f094 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:12.865224 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-426cb333-2090-43ea-bd61-0e8a2f560d20 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:12.867081 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-426cb333-2090-43ea-bd61-0e8a2f560d20 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:12.873983 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-426cb333-2090-43ea-bd61-0e8a2f560d20 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:12.874212 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d61eb279-2692-4e89-a082-459632c1f094 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:12.874451 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-426cb333-2090-43ea-bd61-0e8a2f560d20 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:12.875214 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-426cb333-2090-43ea-bd61-0e8a2f560d20 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:12.875683 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-426cb333-2090-43ea-bd61-0e8a2f560d20 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:12.882969 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d61eb279-2692-4e89-a082-459632c1f094 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69" status: 200 len: 1547 microversion: 2.1 time: 0.177503 Nov 16 16:09:12.884416 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 411/797] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:09:12 2021] GET /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69 => generated 1547 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:09:12.902493 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-8472aa8c-b14d-4a9f-aaa5-dc6c180b26bb tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:12.903029 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-8472aa8c-b14d-4a9f-aaa5-dc6c180b26bb tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:12.909104 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8472aa8c-b14d-4a9f-aaa5-dc6c180b26bb tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:12.909590 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8472aa8c-b14d-4a9f-aaa5-dc6c180b26bb tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:12.910797 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8472aa8c-b14d-4a9f-aaa5-dc6c180b26bb tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:12.911540 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8472aa8c-b14d-4a9f-aaa5-dc6c180b26bb tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:12.978535 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-426cb333-2090-43ea-bd61-0e8a2f560d20 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action" status: 200 len: 35068 microversion: 2.20 time: 0.120032 Nov 16 16:09:12.979217 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 387/798] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:09:12 2021] POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action => generated 35068 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:09:13.011192 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-8472aa8c-b14d-4a9f-aaa5-dc6c180b26bb tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.113344 Nov 16 16:09:13.012040 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 412/799] 10.222.0.46 () {58 vars in 1274 bytes} [Tue Nov 16 16:09:12 2021] GET /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/os-interface => generated 284 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:09:13.991183 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-0f114815-fe3a-45ac-b999-7484822c62c4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:13.992201 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-0f114815-fe3a-45ac-b999-7484822c62c4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:13.998991 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0f114815-fe3a-45ac-b999-7484822c62c4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:13.999431 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0f114815-fe3a-45ac-b999-7484822c62c4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:14.000222 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0f114815-fe3a-45ac-b999-7484822c62c4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:14.000649 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0f114815-fe3a-45ac-b999-7484822c62c4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:14.078959 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-0f114815-fe3a-45ac-b999-7484822c62c4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action" status: 200 len: 36366 microversion: 2.20 time: 0.091590 Nov 16 16:09:14.080017 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 388/800] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:09:13 2021] POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action => generated 36366 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:09:14.266323 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-67d2f497-b2be-4473-b676-924f4c6dc865 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:14.267242 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-67d2f497-b2be-4473-b676-924f4c6dc865 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:14.274172 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-67d2f497-b2be-4473-b676-924f4c6dc865 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:14.274628 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-67d2f497-b2be-4473-b676-924f4c6dc865 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:14.274995 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-df075a03-ccbb-4d20-9582-770e94cd5501 req-5e1496ba-1a4a-4e59-8216-e0b1d87e8681 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6001444a-6dd4-41b0-b53f-eb0c1537cf69", "tag": "f73b554b-5d47-43fc-9731-138b41f213ad"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:14.275441 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-67d2f497-b2be-4473-b676-924f4c6dc865 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:14.275912 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-67d2f497-b2be-4473-b676-924f4c6dc865 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:14.276723 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:09:14.276723 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Nov 16 16:09:14.284484 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-df075a03-ccbb-4d20-9582-770e94cd5501 req-5e1496ba-1a4a-4e59-8216-e0b1d87e8681 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:14.284921 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-df075a03-ccbb-4d20-9582-770e94cd5501 req-5e1496ba-1a4a-4e59-8216-e0b1d87e8681 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:14.299356 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-df075a03-ccbb-4d20-9582-770e94cd5501 req-5e1496ba-1a4a-4e59-8216-e0b1d87e8681 service nova] Creating event network-changed:f73b554b-5d47-43fc-9731-138b41f213ad for instance 6001444a-6dd4-41b0-b53f-eb0c1537cf69 on hv-cinder-81809 Nov 16 16:09:14.304530 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-df075a03-ccbb-4d20-9582-770e94cd5501 req-5e1496ba-1a4a-4e59-8216-e0b1d87e8681 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033782 Nov 16 16:09:14.305136 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 389/801] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:09:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:09:14.373633 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-67d2f497-b2be-4473-b676-924f4c6dc865 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action" status: 200 len: 14 microversion: 2.1 time: 0.111259 Nov 16 16:09:14.374283 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 413/802] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:09:14 2021] POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 16:09:15.092208 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-8eaee821-197c-450f-9c7f-d61400bd0ac9 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:15.093216 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-8eaee821-197c-450f-9c7f-d61400bd0ac9 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:15.100288 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8eaee821-197c-450f-9c7f-d61400bd0ac9 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:15.100739 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8eaee821-197c-450f-9c7f-d61400bd0ac9 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:15.101528 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8eaee821-197c-450f-9c7f-d61400bd0ac9 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:15.101967 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8eaee821-197c-450f-9c7f-d61400bd0ac9 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:15.182690 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-8eaee821-197c-450f-9c7f-d61400bd0ac9 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action" status: 200 len: 37738 microversion: 2.20 time: 0.094940 Nov 16 16:09:15.183606 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 390/803] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:09:15 2021] POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action => generated 37738 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:09:15.385264 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-64c492c8-416b-41be-8a66-2e26cdf5fdbc tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:15.386251 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-64c492c8-416b-41be-8a66-2e26cdf5fdbc tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:15.393100 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-64c492c8-416b-41be-8a66-2e26cdf5fdbc tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:15.393542 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-64c492c8-416b-41be-8a66-2e26cdf5fdbc tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:15.394333 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-64c492c8-416b-41be-8a66-2e26cdf5fdbc tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:15.395496 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-64c492c8-416b-41be-8a66-2e26cdf5fdbc tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:15.456674 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-64c492c8-416b-41be-8a66-2e26cdf5fdbc tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action" status: 200 len: 14 microversion: 2.1 time: 0.075380 Nov 16 16:09:15.457817 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 414/804] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:09:15 2021] POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 16:09:16.196069 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-f928ccc5-901e-4378-a131-c156639e0ee5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:16.197062 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-f928ccc5-901e-4378-a131-c156639e0ee5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:16.203984 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f928ccc5-901e-4378-a131-c156639e0ee5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:16.204424 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f928ccc5-901e-4378-a131-c156639e0ee5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:16.205194 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f928ccc5-901e-4378-a131-c156639e0ee5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:16.205627 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f928ccc5-901e-4378-a131-c156639e0ee5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:16.284779 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-f928ccc5-901e-4378-a131-c156639e0ee5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action" status: 200 len: 38220 microversion: 2.20 time: 0.092921 Nov 16 16:09:16.286060 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 391/805] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:09:16 2021] POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action => generated 38220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:09:16.468590 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7360d757-2073-46d7-a0a7-505edac4008d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:16.469574 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-7360d757-2073-46d7-a0a7-505edac4008d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:16.477623 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7360d757-2073-46d7-a0a7-505edac4008d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:16.478109 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7360d757-2073-46d7-a0a7-505edac4008d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:16.478940 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7360d757-2073-46d7-a0a7-505edac4008d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:16.479353 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7360d757-2073-46d7-a0a7-505edac4008d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:16.541459 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-7360d757-2073-46d7-a0a7-505edac4008d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action" status: 200 len: 14 microversion: 2.1 time: 0.076729 Nov 16 16:09:16.541975 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 415/806] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:09:16 2021] POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 16:09:17.298529 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-7161b7b5-01f2-4106-9e72-c83f603068e3 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:17.299549 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-7161b7b5-01f2-4106-9e72-c83f603068e3 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:17.306726 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7161b7b5-01f2-4106-9e72-c83f603068e3 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:17.307267 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7161b7b5-01f2-4106-9e72-c83f603068e3 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:17.308385 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7161b7b5-01f2-4106-9e72-c83f603068e3 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:17.308992 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7161b7b5-01f2-4106-9e72-c83f603068e3 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:17.387710 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-7161b7b5-01f2-4106-9e72-c83f603068e3 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action" status: 200 len: 38220 microversion: 2.20 time: 0.093182 Nov 16 16:09:17.388351 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 392/807] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:09:17 2021] POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action => generated 38220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:09:17.553087 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6cd5976d-bb47-4209-a931-4eb07a34c68c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:17.554074 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-6cd5976d-bb47-4209-a931-4eb07a34c68c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:17.560855 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6cd5976d-bb47-4209-a931-4eb07a34c68c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:17.561300 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6cd5976d-bb47-4209-a931-4eb07a34c68c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:17.562071 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6cd5976d-bb47-4209-a931-4eb07a34c68c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:17.562501 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6cd5976d-bb47-4209-a931-4eb07a34c68c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:17.641182 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-6cd5976d-bb47-4209-a931-4eb07a34c68c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action" status: 200 len: 14 microversion: 2.1 time: 0.092279 Nov 16 16:09:17.642036 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 416/808] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:09:17 2021] POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 16:09:18.400677 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-9ff3dfa5-d379-4648-8aaa-40c80a98706d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:18.401949 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-9ff3dfa5-d379-4648-8aaa-40c80a98706d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:18.408832 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9ff3dfa5-d379-4648-8aaa-40c80a98706d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:18.409280 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9ff3dfa5-d379-4648-8aaa-40c80a98706d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:18.410051 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9ff3dfa5-d379-4648-8aaa-40c80a98706d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:18.410486 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9ff3dfa5-d379-4648-8aaa-40c80a98706d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:18.474492 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-9ff3dfa5-d379-4648-8aaa-40c80a98706d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action" status: 200 len: 38220 microversion: 2.20 time: 0.078294 Nov 16 16:09:18.475171 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 393/809] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:09:18 2021] POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action => generated 38220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 16 16:09:18.653162 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-769e2644-eaa7-4038-801e-38336ef9c398 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:18.654077 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-769e2644-eaa7-4038-801e-38336ef9c398 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:18.660902 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-769e2644-eaa7-4038-801e-38336ef9c398 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:18.661408 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-769e2644-eaa7-4038-801e-38336ef9c398 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:18.662397 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-769e2644-eaa7-4038-801e-38336ef9c398 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:18.662833 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-769e2644-eaa7-4038-801e-38336ef9c398 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:18.730725 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-769e2644-eaa7-4038-801e-38336ef9c398 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action" status: 200 len: 14 microversion: 2.1 time: 0.081814 Nov 16 16:09:18.731481 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 417/810] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:09:18 2021] POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 16:09:19.487951 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-23a3e533-4f1b-477f-a136-13c2fb059ee8 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:19.488938 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-23a3e533-4f1b-477f-a136-13c2fb059ee8 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:19.495809 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-23a3e533-4f1b-477f-a136-13c2fb059ee8 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:19.496250 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-23a3e533-4f1b-477f-a136-13c2fb059ee8 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:19.497010 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-23a3e533-4f1b-477f-a136-13c2fb059ee8 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:19.497450 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-23a3e533-4f1b-477f-a136-13c2fb059ee8 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:19.569869 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-23a3e533-4f1b-477f-a136-13c2fb059ee8 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action" status: 200 len: 38236 microversion: 2.20 time: 0.085855 Nov 16 16:09:19.570800 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 394/811] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:09:19 2021] POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action => generated 38236 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:09:19.741514 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-79836244-c352-43c3-873e-c3076fdbb17c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:19.742458 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-79836244-c352-43c3-873e-c3076fdbb17c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:19.749378 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-79836244-c352-43c3-873e-c3076fdbb17c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:19.749829 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-79836244-c352-43c3-873e-c3076fdbb17c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:19.750612 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-79836244-c352-43c3-873e-c3076fdbb17c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:19.751054 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-79836244-c352-43c3-873e-c3076fdbb17c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:19.811064 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-79836244-c352-43c3-873e-c3076fdbb17c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action" status: 200 len: 14 microversion: 2.1 time: 0.073395 Nov 16 16:09:19.814827 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 418/812] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:09:19 2021] POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 16:09:20.582315 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-77446d25-e46f-49ee-ad26-299da66f34f2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:20.583382 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-77446d25-e46f-49ee-ad26-299da66f34f2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:20.590248 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-77446d25-e46f-49ee-ad26-299da66f34f2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:20.590697 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-77446d25-e46f-49ee-ad26-299da66f34f2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:20.591484 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-77446d25-e46f-49ee-ad26-299da66f34f2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:20.591930 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-77446d25-e46f-49ee-ad26-299da66f34f2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:20.668929 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-77446d25-e46f-49ee-ad26-299da66f34f2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action" status: 200 len: 38363 microversion: 2.20 time: 0.090594 Nov 16 16:09:20.669848 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 395/813] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:09:20 2021] POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action => generated 38363 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:09:20.680896 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-28d2521a-8475-48a5-b279-2061ce9b2a4b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:20.681493 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-28d2521a-8475-48a5-b279-2061ce9b2a4b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:20.688395 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-28d2521a-8475-48a5-b279-2061ce9b2a4b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:20.688837 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-28d2521a-8475-48a5-b279-2061ce9b2a4b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:20.689606 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-28d2521a-8475-48a5-b279-2061ce9b2a4b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:20.690041 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-28d2521a-8475-48a5-b279-2061ce9b2a4b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:20.713842 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-28d2521a-8475-48a5-b279-2061ce9b2a4b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/ips" status: 200 len: 151 microversion: 2.20 time: 0.038078 Nov 16 16:09:20.714418 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 419/814] 10.222.0.46 () {60 vars in 1288 bytes} [Tue Nov 16 16:09:20 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:09:20.823705 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-29a74e4d-677d-4cb2-9e7c-68e66c770503 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:20.824804 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-29a74e4d-677d-4cb2-9e7c-68e66c770503 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:20.831941 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-29a74e4d-677d-4cb2-9e7c-68e66c770503 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:20.832533 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-29a74e4d-677d-4cb2-9e7c-68e66c770503 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:20.833943 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-29a74e4d-677d-4cb2-9e7c-68e66c770503 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:20.834447 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-29a74e4d-677d-4cb2-9e7c-68e66c770503 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:20.896544 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-29a74e4d-677d-4cb2-9e7c-68e66c770503 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action" status: 200 len: 14 microversion: 2.1 time: 0.076130 Nov 16 16:09:20.897265 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 396/815] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:09:20 2021] POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 16:09:21.907633 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f408bd8e-1510-48ee-b076-54688ecf7b70 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:21.908573 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f408bd8e-1510-48ee-b076-54688ecf7b70 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:21.915653 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f408bd8e-1510-48ee-b076-54688ecf7b70 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:21.916109 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f408bd8e-1510-48ee-b076-54688ecf7b70 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:21.916891 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f408bd8e-1510-48ee-b076-54688ecf7b70 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:21.917333 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f408bd8e-1510-48ee-b076-54688ecf7b70 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:21.981082 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f408bd8e-1510-48ee-b076-54688ecf7b70 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action" status: 200 len: 14 microversion: 2.1 time: 0.076898 Nov 16 16:09:21.984137 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 420/816] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:09:21 2021] POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 16:09:22.992839 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-d46e7137-1e5f-4640-b8ef-49507d9d8d73 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:22.993752 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-d46e7137-1e5f-4640-b8ef-49507d9d8d73 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:23.000547 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d46e7137-1e5f-4640-b8ef-49507d9d8d73 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:23.001020 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d46e7137-1e5f-4640-b8ef-49507d9d8d73 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:23.001789 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d46e7137-1e5f-4640-b8ef-49507d9d8d73 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:23.002245 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d46e7137-1e5f-4640-b8ef-49507d9d8d73 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:23.029873 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-95ac0604-b54f-42d7-997a-094da38b1455 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:23.030689 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-95ac0604-b54f-42d7-997a-094da38b1455 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:23.037921 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-95ac0604-b54f-42d7-997a-094da38b1455 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:23.038381 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-95ac0604-b54f-42d7-997a-094da38b1455 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:23.039183 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-95ac0604-b54f-42d7-997a-094da38b1455 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:23.039652 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-95ac0604-b54f-42d7-997a-094da38b1455 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:23.063971 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-d46e7137-1e5f-4640-b8ef-49507d9d8d73 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action" status: 200 len: 14 microversion: 2.1 time: 0.075481 Nov 16 16:09:23.064844 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 397/817] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:09:22 2021] POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 16:09:23.068048 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.objects.instance [None req-95ac0604-b54f-42d7-997a-094da38b1455 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lazy-loading 'flavor' on Instance uuid 6af3cc97-b45c-4fde-9c9c-47a91dd69630 {{(pid=116084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:09:23.322777 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-95ac0604-b54f-42d7-997a-094da38b1455 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action" status: 202 len: 0 microversion: 2.20 time: 0.297351 Nov 16 16:09:23.323420 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 421/818] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:09:23 2021] POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 16 16:09:23.331779 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-8d20963e-5e88-44d9-87f9-337433a0aac8 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:23.332479 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-8d20963e-5e88-44d9-87f9-337433a0aac8 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:23.339484 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8d20963e-5e88-44d9-87f9-337433a0aac8 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:23.339942 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8d20963e-5e88-44d9-87f9-337433a0aac8 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:23.340998 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8d20963e-5e88-44d9-87f9-337433a0aac8 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:23.341595 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8d20963e-5e88-44d9-87f9-337433a0aac8 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:23.479256 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-8d20963e-5e88-44d9-87f9-337433a0aac8 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:23.487293 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-8d20963e-5e88-44d9-87f9-337433a0aac8 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:23.488806 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-8d20963e-5e88-44d9-87f9-337433a0aac8 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:23.489975 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-8d20963e-5e88-44d9-87f9-337433a0aac8 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 200 len: 1724 microversion: 2.20 time: 0.162217 Nov 16 16:09:23.490631 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 398/819] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:09:23 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:09:24.077280 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-31f35949-7f55-41b1-ac83-5e5605345dd9 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:24.078261 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-31f35949-7f55-41b1-ac83-5e5605345dd9 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:24.085159 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-31f35949-7f55-41b1-ac83-5e5605345dd9 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:24.085603 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-31f35949-7f55-41b1-ac83-5e5605345dd9 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:24.086372 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-31f35949-7f55-41b1-ac83-5e5605345dd9 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:24.086803 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-31f35949-7f55-41b1-ac83-5e5605345dd9 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:24.144613 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-31f35949-7f55-41b1-ac83-5e5605345dd9 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action" status: 200 len: 14 microversion: 2.1 time: 0.071756 Nov 16 16:09:24.145229 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 422/820] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:09:24 2021] POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 16:09:24.508636 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-0efb8553-52c5-4c60-8147-f43ca491012e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:24.509246 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-0efb8553-52c5-4c60-8147-f43ca491012e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:24.515640 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0efb8553-52c5-4c60-8147-f43ca491012e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:24.516091 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0efb8553-52c5-4c60-8147-f43ca491012e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:24.516865 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0efb8553-52c5-4c60-8147-f43ca491012e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:24.517300 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0efb8553-52c5-4c60-8147-f43ca491012e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:24.650255 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-0efb8553-52c5-4c60-8147-f43ca491012e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:24.660920 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-0efb8553-52c5-4c60-8147-f43ca491012e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:24.662458 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-0efb8553-52c5-4c60-8147-f43ca491012e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:24.664570 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-0efb8553-52c5-4c60-8147-f43ca491012e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 200 len: 1724 microversion: 2.20 time: 0.159625 Nov 16 16:09:24.665147 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 399/821] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:09:24 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:09:25.156821 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6d1dd5a2-495f-4fd0-8929-985d221f520a tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:25.158786 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-6d1dd5a2-495f-4fd0-8929-985d221f520a tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:25.165940 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6d1dd5a2-495f-4fd0-8929-985d221f520a tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:25.166395 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6d1dd5a2-495f-4fd0-8929-985d221f520a tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:25.167187 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6d1dd5a2-495f-4fd0-8929-985d221f520a tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:25.167706 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6d1dd5a2-495f-4fd0-8929-985d221f520a tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:25.245009 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-6d1dd5a2-495f-4fd0-8929-985d221f520a tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action" status: 200 len: 4219 microversion: 2.1 time: 0.092301 Nov 16 16:09:25.245758 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 423/822] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:09:25 2021] POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action => generated 4219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:09:25.685242 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-1d2974a5-dcad-4e73-8adf-3b8205ad4abb tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:25.686422 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-1d2974a5-dcad-4e73-8adf-3b8205ad4abb tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:25.697723 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1d2974a5-dcad-4e73-8adf-3b8205ad4abb tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:25.698217 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1d2974a5-dcad-4e73-8adf-3b8205ad4abb tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:25.699029 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1d2974a5-dcad-4e73-8adf-3b8205ad4abb tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:25.699484 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1d2974a5-dcad-4e73-8adf-3b8205ad4abb tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:25.836692 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-1d2974a5-dcad-4e73-8adf-3b8205ad4abb tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:25.844488 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-1d2974a5-dcad-4e73-8adf-3b8205ad4abb tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:25.845951 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-1d2974a5-dcad-4e73-8adf-3b8205ad4abb tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:25.847085 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-1d2974a5-dcad-4e73-8adf-3b8205ad4abb tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 200 len: 1724 microversion: 2.20 time: 0.166010 Nov 16 16:09:25.847663 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 400/823] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:09:25 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:09:26.257251 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-251ec9ad-da98-4e6e-b664-7f8ad517e451 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:26.258281 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-251ec9ad-da98-4e6e-b664-7f8ad517e451 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:26.265174 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-251ec9ad-da98-4e6e-b664-7f8ad517e451 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:26.265623 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-251ec9ad-da98-4e6e-b664-7f8ad517e451 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:26.266399 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-251ec9ad-da98-4e6e-b664-7f8ad517e451 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:26.266837 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-251ec9ad-da98-4e6e-b664-7f8ad517e451 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:26.347663 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-251ec9ad-da98-4e6e-b664-7f8ad517e451 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action" status: 200 len: 12613 microversion: 2.1 time: 0.094849 Nov 16 16:09:26.351673 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 424/824] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:09:26 2021] POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action => generated 12613 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:09:26.865983 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-4ea5fcc3-aa6a-4aaa-8f4c-5e37e913d554 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:26.867120 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-4ea5fcc3-aa6a-4aaa-8f4c-5e37e913d554 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:26.873564 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4ea5fcc3-aa6a-4aaa-8f4c-5e37e913d554 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:26.874015 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4ea5fcc3-aa6a-4aaa-8f4c-5e37e913d554 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:26.874791 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4ea5fcc3-aa6a-4aaa-8f4c-5e37e913d554 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:26.875233 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4ea5fcc3-aa6a-4aaa-8f4c-5e37e913d554 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:27.003856 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-4ea5fcc3-aa6a-4aaa-8f4c-5e37e913d554 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:27.012132 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-4ea5fcc3-aa6a-4aaa-8f4c-5e37e913d554 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:27.013610 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-4ea5fcc3-aa6a-4aaa-8f4c-5e37e913d554 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:27.014750 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-4ea5fcc3-aa6a-4aaa-8f4c-5e37e913d554 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 200 len: 1724 microversion: 2.20 time: 0.152486 Nov 16 16:09:27.015313 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 401/825] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:09:26 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:09:27.359885 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-829fc979-e8dc-472c-8b27-142ad985076f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:27.360889 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-829fc979-e8dc-472c-8b27-142ad985076f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:27.368626 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-829fc979-e8dc-472c-8b27-142ad985076f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:27.369078 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-829fc979-e8dc-472c-8b27-142ad985076f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:27.369868 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-829fc979-e8dc-472c-8b27-142ad985076f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:27.370308 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-829fc979-e8dc-472c-8b27-142ad985076f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:27.455728 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-829fc979-e8dc-472c-8b27-142ad985076f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action" status: 200 len: 18052 microversion: 2.1 time: 0.099653 Nov 16 16:09:27.456391 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 425/826] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:09:27 2021] POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action => generated 18052 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:09:28.032554 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-46606fb4-c31b-4a62-b0e2-cba109763265 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:28.033161 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-46606fb4-c31b-4a62-b0e2-cba109763265 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:28.040145 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-46606fb4-c31b-4a62-b0e2-cba109763265 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:28.040647 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-46606fb4-c31b-4a62-b0e2-cba109763265 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:28.041447 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-46606fb4-c31b-4a62-b0e2-cba109763265 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:28.041873 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-46606fb4-c31b-4a62-b0e2-cba109763265 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:28.173168 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-46606fb4-c31b-4a62-b0e2-cba109763265 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:28.181044 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-46606fb4-c31b-4a62-b0e2-cba109763265 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:28.182804 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-46606fb4-c31b-4a62-b0e2-cba109763265 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:28.184011 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-46606fb4-c31b-4a62-b0e2-cba109763265 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 200 len: 1724 microversion: 2.20 time: 0.155195 Nov 16 16:09:28.184978 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 402/827] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:09:28 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:09:28.467798 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e2ee305d-bbb9-46e2-b939-1e5c2be2860c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:28.468795 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e2ee305d-bbb9-46e2-b939-1e5c2be2860c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:28.475574 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e2ee305d-bbb9-46e2-b939-1e5c2be2860c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:28.477253 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e2ee305d-bbb9-46e2-b939-1e5c2be2860c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:28.478022 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e2ee305d-bbb9-46e2-b939-1e5c2be2860c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:28.478458 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e2ee305d-bbb9-46e2-b939-1e5c2be2860c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:28.564891 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e2ee305d-bbb9-46e2-b939-1e5c2be2860c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action" status: 200 len: 18252 microversion: 2.1 time: 0.101021 Nov 16 16:09:28.565541 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 426/828] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:09:28 2021] POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action => generated 18252 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:09:29.201971 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-552cde65-5c4b-40e0-bde9-1a7006910756 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:29.202566 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-552cde65-5c4b-40e0-bde9-1a7006910756 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:29.208854 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-552cde65-5c4b-40e0-bde9-1a7006910756 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:29.209294 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-552cde65-5c4b-40e0-bde9-1a7006910756 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:29.210053 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-552cde65-5c4b-40e0-bde9-1a7006910756 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:29.210564 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-552cde65-5c4b-40e0-bde9-1a7006910756 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:29.339400 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-552cde65-5c4b-40e0-bde9-1a7006910756 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:29.347102 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-552cde65-5c4b-40e0-bde9-1a7006910756 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:29.348624 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-552cde65-5c4b-40e0-bde9-1a7006910756 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:29.349790 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-552cde65-5c4b-40e0-bde9-1a7006910756 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 200 len: 1724 microversion: 2.20 time: 0.151486 Nov 16 16:09:29.350358 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 403/829] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:09:29 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:09:29.577055 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1feb1d37-4fd6-4189-a480-1ecc4a9fd240 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:29.578052 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1feb1d37-4fd6-4189-a480-1ecc4a9fd240 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:29.584921 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1feb1d37-4fd6-4189-a480-1ecc4a9fd240 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:29.585446 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1feb1d37-4fd6-4189-a480-1ecc4a9fd240 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:29.586340 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1feb1d37-4fd6-4189-a480-1ecc4a9fd240 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:29.586777 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1feb1d37-4fd6-4189-a480-1ecc4a9fd240 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:29.661897 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1feb1d37-4fd6-4189-a480-1ecc4a9fd240 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action" status: 200 len: 20173 microversion: 2.1 time: 0.088754 Nov 16 16:09:29.662562 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 427/830] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:09:29 2021] POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action => generated 20173 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:09:30.369120 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-78e86411-7bf7-4600-9dbd-0973a8af170c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:30.369730 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-78e86411-7bf7-4600-9dbd-0973a8af170c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:30.376036 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-78e86411-7bf7-4600-9dbd-0973a8af170c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:30.376481 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-78e86411-7bf7-4600-9dbd-0973a8af170c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:30.377259 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-78e86411-7bf7-4600-9dbd-0973a8af170c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:30.377692 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-78e86411-7bf7-4600-9dbd-0973a8af170c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:30.505312 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-78e86411-7bf7-4600-9dbd-0973a8af170c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:30.513643 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-78e86411-7bf7-4600-9dbd-0973a8af170c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:30.515133 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-78e86411-7bf7-4600-9dbd-0973a8af170c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:30.516330 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-78e86411-7bf7-4600-9dbd-0973a8af170c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 200 len: 1724 microversion: 2.20 time: 0.151641 Nov 16 16:09:30.516895 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 404/831] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:09:30 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:09:30.675361 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-47012743-3710-4746-88d5-daa983a74347 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:30.676330 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-47012743-3710-4746-88d5-daa983a74347 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:30.683743 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-47012743-3710-4746-88d5-daa983a74347 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:30.684197 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-47012743-3710-4746-88d5-daa983a74347 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:30.685004 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-47012743-3710-4746-88d5-daa983a74347 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:30.685414 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-47012743-3710-4746-88d5-daa983a74347 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:30.758410 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-47012743-3710-4746-88d5-daa983a74347 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action" status: 200 len: 22546 microversion: 2.1 time: 0.086942 Nov 16 16:09:30.759085 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 428/832] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:09:30 2021] POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action => generated 22546 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:09:31.535313 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-94439002-9592-459c-9044-26a93dd8e45d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:31.535940 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-94439002-9592-459c-9044-26a93dd8e45d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:31.542722 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-94439002-9592-459c-9044-26a93dd8e45d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:31.543159 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-94439002-9592-459c-9044-26a93dd8e45d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:31.544052 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-94439002-9592-459c-9044-26a93dd8e45d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:31.544484 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-94439002-9592-459c-9044-26a93dd8e45d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:31.676391 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-94439002-9592-459c-9044-26a93dd8e45d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:31.684554 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-94439002-9592-459c-9044-26a93dd8e45d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:31.686391 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-94439002-9592-459c-9044-26a93dd8e45d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:31.687571 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-94439002-9592-459c-9044-26a93dd8e45d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 200 len: 1724 microversion: 2.20 time: 0.156010 Nov 16 16:09:31.688123 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 405/833] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:09:31 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:09:31.770515 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-29d4eb70-b89c-4958-b44f-effa03f46f93 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:31.771523 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-29d4eb70-b89c-4958-b44f-effa03f46f93 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:31.779471 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-29d4eb70-b89c-4958-b44f-effa03f46f93 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:31.779932 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-29d4eb70-b89c-4958-b44f-effa03f46f93 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:31.780706 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-29d4eb70-b89c-4958-b44f-effa03f46f93 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:31.781136 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-29d4eb70-b89c-4958-b44f-effa03f46f93 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:31.863338 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-29d4eb70-b89c-4958-b44f-effa03f46f93 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action" status: 200 len: 23602 microversion: 2.1 time: 0.096574 Nov 16 16:09:31.863972 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 429/834] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:09:31 2021] POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action => generated 23602 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:09:32.706671 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-2ff805d6-f230-44c7-a55e-cc562767ebd0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:32.707209 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-2ff805d6-f230-44c7-a55e-cc562767ebd0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:32.714003 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2ff805d6-f230-44c7-a55e-cc562767ebd0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:32.714480 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2ff805d6-f230-44c7-a55e-cc562767ebd0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:32.715250 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2ff805d6-f230-44c7-a55e-cc562767ebd0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:32.715715 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2ff805d6-f230-44c7-a55e-cc562767ebd0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:32.847481 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-2ff805d6-f230-44c7-a55e-cc562767ebd0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:32.856349 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-2ff805d6-f230-44c7-a55e-cc562767ebd0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:32.857816 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-2ff805d6-f230-44c7-a55e-cc562767ebd0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:32.858965 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-2ff805d6-f230-44c7-a55e-cc562767ebd0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 200 len: 1724 microversion: 2.20 time: 0.156081 Nov 16 16:09:32.859544 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 406/835] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:09:32 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:09:32.876387 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0b7b6568-f335-47f9-98ca-43bf7757a96b tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:32.877390 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0b7b6568-f335-47f9-98ca-43bf7757a96b tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:32.884310 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0b7b6568-f335-47f9-98ca-43bf7757a96b tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:32.884765 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0b7b6568-f335-47f9-98ca-43bf7757a96b tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:32.885553 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0b7b6568-f335-47f9-98ca-43bf7757a96b tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:32.885993 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0b7b6568-f335-47f9-98ca-43bf7757a96b tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:32.955874 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0b7b6568-f335-47f9-98ca-43bf7757a96b tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action" status: 200 len: 24483 microversion: 2.1 time: 0.083241 Nov 16 16:09:32.956809 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 430/836] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:09:32 2021] POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action => generated 24483 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:09:33.876948 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-03b4812e-e9e1-4cd5-b582-cdfde9e2ce4b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:33.877556 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-03b4812e-e9e1-4cd5-b582-cdfde9e2ce4b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:33.883901 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-03b4812e-e9e1-4cd5-b582-cdfde9e2ce4b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:33.884347 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-03b4812e-e9e1-4cd5-b582-cdfde9e2ce4b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:33.885123 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-03b4812e-e9e1-4cd5-b582-cdfde9e2ce4b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:33.885560 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-03b4812e-e9e1-4cd5-b582-cdfde9e2ce4b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:33.968503 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1edcbb66-6ea5-495d-ae66-504b7fef360a tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:33.969501 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1edcbb66-6ea5-495d-ae66-504b7fef360a tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:33.977290 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1edcbb66-6ea5-495d-ae66-504b7fef360a tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:33.977829 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1edcbb66-6ea5-495d-ae66-504b7fef360a tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:33.978616 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1edcbb66-6ea5-495d-ae66-504b7fef360a tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:33.979050 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1edcbb66-6ea5-495d-ae66-504b7fef360a tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:34.018371 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-03b4812e-e9e1-4cd5-b582-cdfde9e2ce4b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:34.026634 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-03b4812e-e9e1-4cd5-b582-cdfde9e2ce4b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:34.028162 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-03b4812e-e9e1-4cd5-b582-cdfde9e2ce4b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:34.029323 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-03b4812e-e9e1-4cd5-b582-cdfde9e2ce4b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 200 len: 1745 microversion: 2.20 time: 0.156066 Nov 16 16:09:34.029879 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 407/837] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:09:33 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:09:34.058714 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1edcbb66-6ea5-495d-ae66-504b7fef360a tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action" status: 200 len: 25822 microversion: 2.1 time: 0.093997 Nov 16 16:09:34.059361 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 431/838] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:09:33 2021] POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action => generated 25822 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 16:09:35.048330 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-d06830fe-52ad-4996-a407-f194e83109c0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:35.048974 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-d06830fe-52ad-4996-a407-f194e83109c0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:35.055305 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d06830fe-52ad-4996-a407-f194e83109c0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:35.055835 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d06830fe-52ad-4996-a407-f194e83109c0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:35.056620 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d06830fe-52ad-4996-a407-f194e83109c0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:35.057062 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d06830fe-52ad-4996-a407-f194e83109c0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:35.070936 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-826fb88a-ea5f-431b-8a8c-ca8831b52493 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:35.072059 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-826fb88a-ea5f-431b-8a8c-ca8831b52493 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:35.078761 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-826fb88a-ea5f-431b-8a8c-ca8831b52493 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:35.079204 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-826fb88a-ea5f-431b-8a8c-ca8831b52493 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:35.080007 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-826fb88a-ea5f-431b-8a8c-ca8831b52493 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:35.080442 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-826fb88a-ea5f-431b-8a8c-ca8831b52493 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:35.165700 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-826fb88a-ea5f-431b-8a8c-ca8831b52493 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action" status: 200 len: 26624 microversion: 2.1 time: 0.098933 Nov 16 16:09:35.169525 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 432/839] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:09:35 2021] POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action => generated 26624 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 16:09:35.189404 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-d06830fe-52ad-4996-a407-f194e83109c0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:35.198135 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-d06830fe-52ad-4996-a407-f194e83109c0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:35.199620 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-d06830fe-52ad-4996-a407-f194e83109c0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:35.200776 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-d06830fe-52ad-4996-a407-f194e83109c0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 200 len: 1745 microversion: 2.20 time: 0.156108 Nov 16 16:09:35.201308 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 408/840] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:09:35 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:09:35.975433 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-39cf6ec1-7656-455e-8995-a344a590d931 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-999167629"}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:35.976089 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-39cf6ec1-7656-455e-8995-a344a590d931 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:35.983366 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-39cf6ec1-7656-455e-8995-a344a590d931 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:35.983768 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-39cf6ec1-7656-455e-8995-a344a590d931 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:35.984555 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-39cf6ec1-7656-455e-8995-a344a590d931 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:35.984992 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-39cf6ec1-7656-455e-8995-a344a590d931 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:36.120392 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.network.security_group_api [None req-39cf6ec1-7656-455e-8995-a344a590d931 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Removing security group 214fc19b-118a-46ba-843f-b8d426e798fc from port 46c407d4-a5b9-4ded-af69-53e4b90a70c8 Nov 16 16:09:36.177037 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-017b36dc-667a-431c-aaa8-b2048934e42b tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:36.177989 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-017b36dc-667a-431c-aaa8-b2048934e42b tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:36.186130 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-017b36dc-667a-431c-aaa8-b2048934e42b tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:36.187306 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-017b36dc-667a-431c-aaa8-b2048934e42b tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:36.188326 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-017b36dc-667a-431c-aaa8-b2048934e42b tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:36.188947 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-017b36dc-667a-431c-aaa8-b2048934e42b tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:36.278611 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-017b36dc-667a-431c-aaa8-b2048934e42b tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action" status: 200 len: 27279 microversion: 2.1 time: 0.104913 Nov 16 16:09:36.282970 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 409/841] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:09:36 2021] POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action => generated 27279 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 16:09:36.286747 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-16a7cf5b-967e-4480-a68f-4bf440ead726 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:36.287487 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-16a7cf5b-967e-4480-a68f-4bf440ead726 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:36.300576 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-16a7cf5b-967e-4480-a68f-4bf440ead726 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:36.301032 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-16a7cf5b-967e-4480-a68f-4bf440ead726 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:36.302350 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-16a7cf5b-967e-4480-a68f-4bf440ead726 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:36.302807 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-16a7cf5b-967e-4480-a68f-4bf440ead726 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:36.530825 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-16a7cf5b-967e-4480-a68f-4bf440ead726 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:36.549947 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-16a7cf5b-967e-4480-a68f-4bf440ead726 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:36.551670 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-16a7cf5b-967e-4480-a68f-4bf440ead726 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:36.560993 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-16a7cf5b-967e-4480-a68f-4bf440ead726 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 200 len: 1740 microversion: 2.20 time: 0.280514 Nov 16 16:09:36.562052 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 410/842] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:09:36 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 1740 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:09:36.607280 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-39cf6ec1-7656-455e-8995-a344a590d931 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "POST /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d/action" status: 202 len: 0 microversion: 2.1 time: 0.635833 Nov 16 16:09:36.611657 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 433/843] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:09:35 2021] POST /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d/action => generated 0 bytes in 637 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:09:36.850940 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-85379cb4-604f-414b-9178-ec3ebb59bc10 req-6b7ae60c-327f-4dfa-9cb5-53f64e5a97d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5a9f9cd-86b0-4029-b3b3-c25470b8025d", "tag": "46c407d4-a5b9-4ded-af69-53e4b90a70c8"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:36.853860 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:09:36.853860 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Nov 16 16:09:36.863021 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-85379cb4-604f-414b-9178-ec3ebb59bc10 req-6b7ae60c-327f-4dfa-9cb5-53f64e5a97d6 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:36.863727 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-85379cb4-604f-414b-9178-ec3ebb59bc10 req-6b7ae60c-327f-4dfa-9cb5-53f64e5a97d6 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:36.876992 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-85379cb4-604f-414b-9178-ec3ebb59bc10 req-6b7ae60c-327f-4dfa-9cb5-53f64e5a97d6 service nova] Creating event network-changed:46c407d4-a5b9-4ded-af69-53e4b90a70c8 for instance c5a9f9cd-86b0-4029-b3b3-c25470b8025d on hv-cinder-81809 Nov 16 16:09:36.882954 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-85379cb4-604f-414b-9178-ec3ebb59bc10 req-6b7ae60c-327f-4dfa-9cb5-53f64e5a97d6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.266144 Nov 16 16:09:36.884752 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 411/844] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:09:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:09:37.291342 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-fe651dcb-a2a3-46ed-a4bf-eedcc14dddad tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:37.292508 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-fe651dcb-a2a3-46ed-a4bf-eedcc14dddad tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:37.305634 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fe651dcb-a2a3-46ed-a4bf-eedcc14dddad tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:37.308157 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fe651dcb-a2a3-46ed-a4bf-eedcc14dddad tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:37.309211 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fe651dcb-a2a3-46ed-a4bf-eedcc14dddad tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:37.310743 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fe651dcb-a2a3-46ed-a4bf-eedcc14dddad tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:37.400662 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-fe651dcb-a2a3-46ed-a4bf-eedcc14dddad tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action" status: 200 len: 27883 microversion: 2.1 time: 0.113813 Nov 16 16:09:37.402077 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 434/845] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:09:37 2021] POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action => generated 27883 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:09:37.582712 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-2f8f54de-59fb-4777-bd1a-54680a6e0ad2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:37.584231 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-2f8f54de-59fb-4777-bd1a-54680a6e0ad2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:37.592426 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2f8f54de-59fb-4777-bd1a-54680a6e0ad2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:37.593178 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2f8f54de-59fb-4777-bd1a-54680a6e0ad2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:37.594356 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2f8f54de-59fb-4777-bd1a-54680a6e0ad2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:37.594987 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2f8f54de-59fb-4777-bd1a-54680a6e0ad2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:38.202674 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-3527c57a-3ccf-4788-93bd-c02388c9c8d2 req-d21a563a-11fe-4a54-b153-1e6048d92b59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6af3cc97-b45c-4fde-9c9c-47a91dd69630", "name": "network-vif-plugged", "status": "completed", "tag": "3d367ce8-61fa-49f0-b6d2-d3d025285525"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:38.205223 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:09:38.205223 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Nov 16 16:09:38.216875 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-3527c57a-3ccf-4788-93bd-c02388c9c8d2 req-d21a563a-11fe-4a54-b153-1e6048d92b59 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:38.217597 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-3527c57a-3ccf-4788-93bd-c02388c9c8d2 req-d21a563a-11fe-4a54-b153-1e6048d92b59 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:38.219244 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-2f8f54de-59fb-4777-bd1a-54680a6e0ad2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:38.231237 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-3527c57a-3ccf-4788-93bd-c02388c9c8d2 req-d21a563a-11fe-4a54-b153-1e6048d92b59 service nova] Creating event network-vif-plugged:3d367ce8-61fa-49f0-b6d2-d3d025285525 for instance 6af3cc97-b45c-4fde-9c9c-47a91dd69630 on hv-cinder-81809 Nov 16 16:09:38.234698 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-2f8f54de-59fb-4777-bd1a-54680a6e0ad2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:38.236531 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-2f8f54de-59fb-4777-bd1a-54680a6e0ad2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:38.237953 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-2f8f54de-59fb-4777-bd1a-54680a6e0ad2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 200 len: 1740 microversion: 2.20 time: 0.659923 Nov 16 16:09:38.239358 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-3527c57a-3ccf-4788-93bd-c02388c9c8d2 req-d21a563a-11fe-4a54-b153-1e6048d92b59 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124623 Nov 16 16:09:38.241026 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 435/846] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:09:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:09:38.250281 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 412/847] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:09:37 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 1740 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:09:38.349427 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c5dc7737-1b9e-48a1-a93a-870966789c1f tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:38.350145 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c5dc7737-1b9e-48a1-a93a-870966789c1f tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:38.364654 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c5dc7737-1b9e-48a1-a93a-870966789c1f tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:38.365471 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c5dc7737-1b9e-48a1-a93a-870966789c1f tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:38.366373 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c5dc7737-1b9e-48a1-a93a-870966789c1f tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:38.366921 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c5dc7737-1b9e-48a1-a93a-870966789c1f tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:38.412669 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-115a460f-ef87-4baa-bb8e-452c2a4d0cfb tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:38.413811 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-115a460f-ef87-4baa-bb8e-452c2a4d0cfb tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:38.420086 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-115a460f-ef87-4baa-bb8e-452c2a4d0cfb tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:38.420782 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-115a460f-ef87-4baa-bb8e-452c2a4d0cfb tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:38.421755 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-115a460f-ef87-4baa-bb8e-452c2a4d0cfb tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:38.422337 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-115a460f-ef87-4baa-bb8e-452c2a4d0cfb tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:38.463591 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.objects.instance [None req-c5dc7737-1b9e-48a1-a93a-870966789c1f tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lazy-loading 'services' on Instance uuid c5a9f9cd-86b0-4029-b3b3-c25470b8025d {{(pid=116084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:09:38.516205 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-115a460f-ef87-4baa-bb8e-452c2a4d0cfb tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action" status: 200 len: 28196 microversion: 2.1 time: 0.102269 Nov 16 16:09:38.521221 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 413/848] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:09:38 2021] POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action => generated 28196 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 16:09:38.552446 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c5dc7737-1b9e-48a1-a93a-870966789c1f tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d/os-volume_attachments/9c753700-76bd-4833-b34c-e3d82b0578e6" status: 202 len: 0 microversion: 2.1 time: 0.207973 Nov 16 16:09:38.553265 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 436/849] 10.222.0.46 () {58 vars in 1415 bytes} [Tue Nov 16 16:09:38 2021] DELETE /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d/os-volume_attachments/9c753700-76bd-4833-b34c-e3d82b0578e6 => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:09:38.562595 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-be4d97da-1bff-4fed-be1b-7330754d6a7a tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:38.563620 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-be4d97da-1bff-4fed-be1b-7330754d6a7a tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:38.575922 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-be4d97da-1bff-4fed-be1b-7330754d6a7a tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:38.577284 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-be4d97da-1bff-4fed-be1b-7330754d6a7a tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:38.578290 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-be4d97da-1bff-4fed-be1b-7330754d6a7a tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:38.578719 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-be4d97da-1bff-4fed-be1b-7330754d6a7a tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:38.627840 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-be4d97da-1bff-4fed-be1b-7330754d6a7a tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068056 Nov 16 16:09:38.629332 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 414/850] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 16 16:09:38 2021] GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:09:38.955589 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-0b445291-57e2-4a8c-a357-6ca4c9ea4306 req-aefd84fe-3b44-400b-bcd4-1098d99f99e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5a9f9cd-86b0-4029-b3b3-c25470b8025d", "tag": "46c407d4-a5b9-4ded-af69-53e4b90a70c8"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:38.959775 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:09:38.959775 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Nov 16 16:09:38.972203 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-0b445291-57e2-4a8c-a357-6ca4c9ea4306 req-aefd84fe-3b44-400b-bcd4-1098d99f99e4 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:38.972806 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-0b445291-57e2-4a8c-a357-6ca4c9ea4306 req-aefd84fe-3b44-400b-bcd4-1098d99f99e4 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:38.990473 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-0b445291-57e2-4a8c-a357-6ca4c9ea4306 req-aefd84fe-3b44-400b-bcd4-1098d99f99e4 service nova] Creating event network-changed:46c407d4-a5b9-4ded-af69-53e4b90a70c8 for instance c5a9f9cd-86b0-4029-b3b3-c25470b8025d on hv-cinder-81809 Nov 16 16:09:38.997191 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-0b445291-57e2-4a8c-a357-6ca4c9ea4306 req-aefd84fe-3b44-400b-bcd4-1098d99f99e4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045454 Nov 16 16:09:39.000635 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 437/851] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:09:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:09:39.257490 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-54bde980-da52-4cec-9ce7-181912efcee2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:39.259073 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-54bde980-da52-4cec-9ce7-181912efcee2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:39.269193 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-54bde980-da52-4cec-9ce7-181912efcee2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:39.269876 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-54bde980-da52-4cec-9ce7-181912efcee2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:39.271674 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-54bde980-da52-4cec-9ce7-181912efcee2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:39.275478 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-54bde980-da52-4cec-9ce7-181912efcee2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:39.496757 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-54bde980-da52-4cec-9ce7-181912efcee2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:39.506901 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-54bde980-da52-4cec-9ce7-181912efcee2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:39.509540 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-54bde980-da52-4cec-9ce7-181912efcee2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:39.510908 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-54bde980-da52-4cec-9ce7-181912efcee2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 200 len: 1740 microversion: 2.20 time: 0.257138 Nov 16 16:09:39.511997 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 415/852] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:09:39 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 1740 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:09:39.532252 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-541ba715-a2ff-4e70-b21a-b35a6c99ef4c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:39.533349 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-541ba715-a2ff-4e70-b21a-b35a6c99ef4c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:39.550846 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-541ba715-a2ff-4e70-b21a-b35a6c99ef4c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:39.551420 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-541ba715-a2ff-4e70-b21a-b35a6c99ef4c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:39.552361 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-541ba715-a2ff-4e70-b21a-b35a6c99ef4c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:39.552905 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-541ba715-a2ff-4e70-b21a-b35a6c99ef4c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:39.644955 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-692b4bac-9925-46ca-be46-940cf7dd08e8 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:39.646575 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-692b4bac-9925-46ca-be46-940cf7dd08e8 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:39.648944 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-541ba715-a2ff-4e70-b21a-b35a6c99ef4c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action" status: 200 len: 28196 microversion: 2.1 time: 0.121652 Nov 16 16:09:39.649897 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 438/853] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:09:39 2021] POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action => generated 28196 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:09:39.658793 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-692b4bac-9925-46ca-be46-940cf7dd08e8 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:39.659504 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-692b4bac-9925-46ca-be46-940cf7dd08e8 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:39.661102 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-692b4bac-9925-46ca-be46-940cf7dd08e8 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:39.663504 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-692b4bac-9925-46ca-be46-940cf7dd08e8 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:39.714790 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-692b4bac-9925-46ca-be46-940cf7dd08e8 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076510 Nov 16 16:09:39.715943 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 416/854] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 16 16:09:39 2021] GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 16 16:09:39.727235 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-5ffb5d20-0a7f-4047-8eff-ca1dda6a3708 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:39.727813 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-5ffb5d20-0a7f-4047-8eff-ca1dda6a3708 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:39.738983 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5ffb5d20-0a7f-4047-8eff-ca1dda6a3708 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:39.739436 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5ffb5d20-0a7f-4047-8eff-ca1dda6a3708 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:39.740291 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5ffb5d20-0a7f-4047-8eff-ca1dda6a3708 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:39.740725 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5ffb5d20-0a7f-4047-8eff-ca1dda6a3708 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:39.826677 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-5ffb5d20-0a7f-4047-8eff-ca1dda6a3708 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] HTTP exception thrown: Instance c5a9f9cd-86b0-4029-b3b3-c25470b8025d is not attached to volume 9c753700-76bd-4833-b34c-e3d82b0578e6 Nov 16 16:09:39.827287 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-5ffb5d20-0a7f-4047-8eff-ca1dda6a3708 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Returning 404 to user: Instance c5a9f9cd-86b0-4029-b3b3-c25470b8025d is not attached to volume 9c753700-76bd-4833-b34c-e3d82b0578e6 {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:09:39.828198 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-5ffb5d20-0a7f-4047-8eff-ca1dda6a3708 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d/os-volume_attachments/9c753700-76bd-4833-b34c-e3d82b0578e6" status: 404 len: 154 microversion: 2.1 time: 0.106486 Nov 16 16:09:39.830640 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 439/855] 10.222.0.46 () {58 vars in 1415 bytes} [Tue Nov 16 16:09:39 2021] DELETE /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d/os-volume_attachments/9c753700-76bd-4833-b34c-e3d82b0578e6 => generated 154 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:09:40.530007 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-d2fa68da-b5e8-443e-b2e4-eaf5feee2131 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:40.530925 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-d2fa68da-b5e8-443e-b2e4-eaf5feee2131 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:40.537535 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d2fa68da-b5e8-443e-b2e4-eaf5feee2131 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:40.537980 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d2fa68da-b5e8-443e-b2e4-eaf5feee2131 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:40.539523 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d2fa68da-b5e8-443e-b2e4-eaf5feee2131 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:40.539976 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d2fa68da-b5e8-443e-b2e4-eaf5feee2131 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:40.661806 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3f88bd7a-d57c-4825-a5ed-eb8199cd753f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:40.663529 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-3f88bd7a-d57c-4825-a5ed-eb8199cd753f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:40.671370 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3f88bd7a-d57c-4825-a5ed-eb8199cd753f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:40.672127 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3f88bd7a-d57c-4825-a5ed-eb8199cd753f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:40.672920 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3f88bd7a-d57c-4825-a5ed-eb8199cd753f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:40.673361 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3f88bd7a-d57c-4825-a5ed-eb8199cd753f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:40.694538 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-d2fa68da-b5e8-443e-b2e4-eaf5feee2131 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:40.703859 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-d2fa68da-b5e8-443e-b2e4-eaf5feee2131 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:40.705408 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-d2fa68da-b5e8-443e-b2e4-eaf5feee2131 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:40.706566 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-d2fa68da-b5e8-443e-b2e4-eaf5feee2131 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 200 len: 1740 microversion: 2.20 time: 0.180992 Nov 16 16:09:40.707123 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 417/856] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:09:40 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 1740 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:09:40.756187 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-3f88bd7a-d57c-4825-a5ed-eb8199cd753f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action" status: 200 len: 28261 microversion: 2.1 time: 0.097763 Nov 16 16:09:40.757847 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 440/857] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:09:40 2021] POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action => generated 28261 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:09:40.993162 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-86dee2a2-6de0-42a3-96b3-d97bcda9d4ae tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:40.993980 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-86dee2a2-6de0-42a3-96b3-d97bcda9d4ae tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:41.003430 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-86dee2a2-6de0-42a3-96b3-d97bcda9d4ae tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:41.004121 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-86dee2a2-6de0-42a3-96b3-d97bcda9d4ae tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:41.005139 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-86dee2a2-6de0-42a3-96b3-d97bcda9d4ae tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:41.005846 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-86dee2a2-6de0-42a3-96b3-d97bcda9d4ae tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:41.041744 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-86dee2a2-6de0-42a3-96b3-d97bcda9d4ae tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Going to try to terminate instance {{(pid=116085) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 16:09:41.145167 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-86dee2a2-6de0-42a3-96b3-d97bcda9d4ae tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d" status: 204 len: 0 microversion: 2.1 time: 0.159214 Nov 16 16:09:41.146177 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 418/858] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 16 16:09:40 2021] DELETE /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 16:09:41.155883 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-03131702-fd03-4a96-bad5-2fa236bc31dd tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:41.156638 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-03131702-fd03-4a96-bad5-2fa236bc31dd tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:41.163708 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-03131702-fd03-4a96-bad5-2fa236bc31dd tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:41.164448 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-03131702-fd03-4a96-bad5-2fa236bc31dd tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:41.165435 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-03131702-fd03-4a96-bad5-2fa236bc31dd tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:41.166046 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-03131702-fd03-4a96-bad5-2fa236bc31dd tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:41.321628 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-03131702-fd03-4a96-bad5-2fa236bc31dd tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a73e3dbb5a4da5976643ad8224f56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ed7321198471eb4645081b697d234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:41.329583 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-03131702-fd03-4a96-bad5-2fa236bc31dd tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d" status: 200 len: 1555 microversion: 2.1 time: 0.179128 Nov 16 16:09:41.333732 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 441/859] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:09:41 2021] GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d => generated 1555 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:09:41.726098 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-06354108-3d55-4a91-ba89-65c4eec4abf4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:41.727934 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-06354108-3d55-4a91-ba89-65c4eec4abf4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:41.737922 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-06354108-3d55-4a91-ba89-65c4eec4abf4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:41.738486 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-06354108-3d55-4a91-ba89-65c4eec4abf4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:41.739374 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-06354108-3d55-4a91-ba89-65c4eec4abf4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:41.739907 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-06354108-3d55-4a91-ba89-65c4eec4abf4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:41.767891 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-eae92303-32d9-4e3c-afef-02aa56004e5a tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:41.769454 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-eae92303-32d9-4e3c-afef-02aa56004e5a tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:41.777103 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-eae92303-32d9-4e3c-afef-02aa56004e5a tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:41.777894 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-eae92303-32d9-4e3c-afef-02aa56004e5a tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:41.778873 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-eae92303-32d9-4e3c-afef-02aa56004e5a tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:41.779506 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-eae92303-32d9-4e3c-afef-02aa56004e5a tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:41.857074 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-eae92303-32d9-4e3c-afef-02aa56004e5a tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action" status: 200 len: 28487 microversion: 2.1 time: 0.092575 Nov 16 16:09:41.857882 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 442/860] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:09:41 2021] POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action => generated 28487 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 16:09:41.893857 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-06354108-3d55-4a91-ba89-65c4eec4abf4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:41.902790 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-06354108-3d55-4a91-ba89-65c4eec4abf4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:41.904888 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-06354108-3d55-4a91-ba89-65c4eec4abf4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:41.906317 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-06354108-3d55-4a91-ba89-65c4eec4abf4 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 200 len: 1740 microversion: 2.20 time: 0.184643 Nov 16 16:09:41.907067 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 419/861] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:09:41 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 1740 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:09:42.350162 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f339bbaa-ec86-4306-8214-243abcb46acf tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:42.351452 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f339bbaa-ec86-4306-8214-243abcb46acf tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:42.359421 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f339bbaa-ec86-4306-8214-243abcb46acf tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:42.359900 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f339bbaa-ec86-4306-8214-243abcb46acf tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:42.362984 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f339bbaa-ec86-4306-8214-243abcb46acf tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:42.363635 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f339bbaa-ec86-4306-8214-243abcb46acf tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:42.537228 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f339bbaa-ec86-4306-8214-243abcb46acf tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a73e3dbb5a4da5976643ad8224f56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ed7321198471eb4645081b697d234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:42.547106 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f339bbaa-ec86-4306-8214-243abcb46acf tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d" status: 200 len: 1555 microversion: 2.1 time: 0.202674 Nov 16 16:09:42.549589 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 443/862] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:09:42 2021] GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d => generated 1555 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:09:42.870210 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-f4eae3b7-246b-4a60-81d9-6cdd345a1c35 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:42.871243 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-f4eae3b7-246b-4a60-81d9-6cdd345a1c35 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:42.878442 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f4eae3b7-246b-4a60-81d9-6cdd345a1c35 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:42.878886 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f4eae3b7-246b-4a60-81d9-6cdd345a1c35 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:42.879717 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f4eae3b7-246b-4a60-81d9-6cdd345a1c35 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:42.880155 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f4eae3b7-246b-4a60-81d9-6cdd345a1c35 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:42.933807 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-bd694763-7a76-4792-8482-cd48757673ef tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:42.934636 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-bd694763-7a76-4792-8482-cd48757673ef tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:42.948559 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bd694763-7a76-4792-8482-cd48757673ef tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:42.949002 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bd694763-7a76-4792-8482-cd48757673ef tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:42.949806 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bd694763-7a76-4792-8482-cd48757673ef tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:42.950234 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bd694763-7a76-4792-8482-cd48757673ef tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:42.980854 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-f4eae3b7-246b-4a60-81d9-6cdd345a1c35 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action" status: 200 len: 28655 microversion: 2.1 time: 0.115111 Nov 16 16:09:42.981551 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 420/863] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:09:42 2021] POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action => generated 28655 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:09:43.120525 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-bd694763-7a76-4792-8482-cd48757673ef tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:43.139078 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-bd694763-7a76-4792-8482-cd48757673ef tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:43.139078 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-bd694763-7a76-4792-8482-cd48757673ef tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:43.140736 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-bd694763-7a76-4792-8482-cd48757673ef tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 200 len: 1740 microversion: 2.20 time: 0.218050 Nov 16 16:09:43.153616 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 444/864] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:09:42 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 1740 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:09:43.571663 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-b3110faa-321f-47f7-84de-cb08cc4cf48a tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:43.572560 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-b3110faa-321f-47f7-84de-cb08cc4cf48a tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:43.582754 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b3110faa-321f-47f7-84de-cb08cc4cf48a tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:43.583261 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b3110faa-321f-47f7-84de-cb08cc4cf48a tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:43.584391 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b3110faa-321f-47f7-84de-cb08cc4cf48a tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:43.584965 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b3110faa-321f-47f7-84de-cb08cc4cf48a tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:43.658275 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-9b045b4a-292b-43c0-b831-33c205becdf4 req-f754acf7-951d-4093-80ef-8421709fe8f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5a9f9cd-86b0-4029-b3b3-c25470b8025d", "name": "network-vif-deleted", "tag": "46c407d4-a5b9-4ded-af69-53e4b90a70c8"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:43.659858 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:09:43.659858 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Nov 16 16:09:43.678231 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-9b045b4a-292b-43c0-b831-33c205becdf4 req-f754acf7-951d-4093-80ef-8421709fe8f8 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:43.678835 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-9b045b4a-292b-43c0-b831-33c205becdf4 req-f754acf7-951d-4093-80ef-8421709fe8f8 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:43.691719 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-9b045b4a-292b-43c0-b831-33c205becdf4 req-f754acf7-951d-4093-80ef-8421709fe8f8 service nova] Creating event network-vif-deleted:46c407d4-a5b9-4ded-af69-53e4b90a70c8 for instance c5a9f9cd-86b0-4029-b3b3-c25470b8025d on hv-cinder-81809 Nov 16 16:09:43.697692 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-9b045b4a-292b-43c0-b831-33c205becdf4 req-f754acf7-951d-4093-80ef-8421709fe8f8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122332 Nov 16 16:09:43.698934 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 445/865] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:09:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:09:43.701527 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-b3110faa-321f-47f7-84de-cb08cc4cf48a tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a73e3dbb5a4da5976643ad8224f56e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ed7321198471eb4645081b697d234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:43.714353 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-b3110faa-321f-47f7-84de-cb08cc4cf48a tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d" status: 200 len: 1513 microversion: 2.1 time: 0.152349 Nov 16 16:09:43.724094 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 421/866] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:09:43 2021] GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:09:43.996109 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c72df71c-ea34-4f41-ae7c-b3e5425a2f0c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:43.997727 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c72df71c-ea34-4f41-ae7c-b3e5425a2f0c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:44.007782 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c72df71c-ea34-4f41-ae7c-b3e5425a2f0c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:44.009118 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c72df71c-ea34-4f41-ae7c-b3e5425a2f0c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:44.021965 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c72df71c-ea34-4f41-ae7c-b3e5425a2f0c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:44.024068 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c72df71c-ea34-4f41-ae7c-b3e5425a2f0c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:44.102633 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c72df71c-ea34-4f41-ae7c-b3e5425a2f0c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action" status: 200 len: 28655 microversion: 2.1 time: 0.111411 Nov 16 16:09:44.104181 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 446/867] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:09:43 2021] POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action => generated 28655 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:09:44.160879 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-da19178d-323a-4c80-b96a-fb584f6e095b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:44.162326 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-da19178d-323a-4c80-b96a-fb584f6e095b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:44.173472 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-da19178d-323a-4c80-b96a-fb584f6e095b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:44.174092 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-da19178d-323a-4c80-b96a-fb584f6e095b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:44.175057 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-da19178d-323a-4c80-b96a-fb584f6e095b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:44.175546 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-da19178d-323a-4c80-b96a-fb584f6e095b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:44.344877 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-da19178d-323a-4c80-b96a-fb584f6e095b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:44.353548 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-da19178d-323a-4c80-b96a-fb584f6e095b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:44.355084 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-da19178d-323a-4c80-b96a-fb584f6e095b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:44.356273 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-da19178d-323a-4c80-b96a-fb584f6e095b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 200 len: 1740 microversion: 2.20 time: 0.199860 Nov 16 16:09:44.356996 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 422/868] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:09:44 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 1740 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:09:44.734246 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-fa19f6a0-37e2-47be-b3d8-98015b7bd930 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:44.735643 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-fa19f6a0-37e2-47be-b3d8-98015b7bd930 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] [instance: c5a9f9cd-86b0-4029-b3b3-c25470b8025d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:44.745195 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fa19f6a0-37e2-47be-b3d8-98015b7bd930 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:44.745734 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fa19f6a0-37e2-47be-b3d8-98015b7bd930 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:44.746592 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fa19f6a0-37e2-47be-b3d8-98015b7bd930 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:44.747095 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fa19f6a0-37e2-47be-b3d8-98015b7bd930 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:44.762593 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-fa19f6a0-37e2-47be-b3d8-98015b7bd930 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] HTTP exception thrown: Instance c5a9f9cd-86b0-4029-b3b3-c25470b8025d could not be found. Nov 16 16:09:44.763302 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-fa19f6a0-37e2-47be-b3d8-98015b7bd930 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Returning 404 to user: Instance c5a9f9cd-86b0-4029-b3b3-c25470b8025d could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:09:44.764233 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-fa19f6a0-37e2-47be-b3d8-98015b7bd930 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d" status: 404 len: 111 microversion: 2.1 time: 0.035828 Nov 16 16:09:44.764872 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 447/869] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:09:44 2021] GET /compute/v2.1/servers/c5a9f9cd-86b0-4029-b3b3-c25470b8025d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:09:44.772744 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-40363d0c-20c9-49a4-ae76-46a3aeb9e663 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] Calling method '.version_select at 0x7f113c5fb280>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:44.795007 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-40363d0c-20c9-49a4-ae76-46a3aeb9e663 tempest-TestMinimumBasicScenario-681406792 tempest-TestMinimumBasicScenario-681406792-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-751069602" status: 202 len: 0 microversion: 2.1 time: 0.025768 Nov 16 16:09:44.795907 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 423/870] 10.222.0.46 () {58 vars in 1268 bytes} [Tue Nov 16 16:09:44 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-751069602 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:09:45.115930 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d42f9cf1-73ae-4b64-9faf-c754143bb8eb tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:45.117597 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d42f9cf1-73ae-4b64-9faf-c754143bb8eb tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:45.123993 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d42f9cf1-73ae-4b64-9faf-c754143bb8eb tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:45.124514 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d42f9cf1-73ae-4b64-9faf-c754143bb8eb tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:45.125377 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d42f9cf1-73ae-4b64-9faf-c754143bb8eb tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:45.125826 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d42f9cf1-73ae-4b64-9faf-c754143bb8eb tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:45.200756 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d42f9cf1-73ae-4b64-9faf-c754143bb8eb tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action" status: 200 len: 28655 microversion: 2.1 time: 0.089801 Nov 16 16:09:45.204937 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 448/871] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:09:45 2021] POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action => generated 28655 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:09:45.375990 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-feeddf41-b7c9-4deb-ab4d-efe5850a9342 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:45.376612 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-feeddf41-b7c9-4deb-ab4d-efe5850a9342 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:45.384782 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-feeddf41-b7c9-4deb-ab4d-efe5850a9342 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:45.385232 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-feeddf41-b7c9-4deb-ab4d-efe5850a9342 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:45.386270 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-feeddf41-b7c9-4deb-ab4d-efe5850a9342 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:45.386899 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-feeddf41-b7c9-4deb-ab4d-efe5850a9342 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:45.541512 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-feeddf41-b7c9-4deb-ab4d-efe5850a9342 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:45.550359 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-feeddf41-b7c9-4deb-ab4d-efe5850a9342 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:45.552143 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-feeddf41-b7c9-4deb-ab4d-efe5850a9342 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:45.553313 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-feeddf41-b7c9-4deb-ab4d-efe5850a9342 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 200 len: 1740 microversion: 2.20 time: 0.182329 Nov 16 16:09:45.567260 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 424/872] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:09:45 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 1740 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:09:46.213334 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-227c44fb-2300-4a13-b754-7a811aad559e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:46.219854 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-227c44fb-2300-4a13-b754-7a811aad559e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:46.227341 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-227c44fb-2300-4a13-b754-7a811aad559e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:46.227897 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-227c44fb-2300-4a13-b754-7a811aad559e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:46.228757 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-227c44fb-2300-4a13-b754-7a811aad559e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:46.229413 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-227c44fb-2300-4a13-b754-7a811aad559e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:46.320246 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-227c44fb-2300-4a13-b754-7a811aad559e tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action" status: 200 len: 28989 microversion: 2.1 time: 0.110940 Nov 16 16:09:46.325146 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 449/873] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:09:46 2021] POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action => generated 28989 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 16:09:46.575290 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-44b350cc-d10a-4b32-bc9d-47b1de8f1266 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:46.576089 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-44b350cc-d10a-4b32-bc9d-47b1de8f1266 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:46.582718 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-44b350cc-d10a-4b32-bc9d-47b1de8f1266 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:46.583368 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-44b350cc-d10a-4b32-bc9d-47b1de8f1266 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:46.584386 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-44b350cc-d10a-4b32-bc9d-47b1de8f1266 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:46.584817 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-44b350cc-d10a-4b32-bc9d-47b1de8f1266 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:46.737441 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-44b350cc-d10a-4b32-bc9d-47b1de8f1266 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:46.747701 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-44b350cc-d10a-4b32-bc9d-47b1de8f1266 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:46.749167 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-44b350cc-d10a-4b32-bc9d-47b1de8f1266 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:46.750318 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-44b350cc-d10a-4b32-bc9d-47b1de8f1266 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 200 len: 1740 microversion: 2.20 time: 0.179394 Nov 16 16:09:46.750962 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 425/874] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:09:46 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 1740 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:09:47.332833 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-11b7d9b9-5994-45be-9dff-974ade973675 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:47.333830 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-11b7d9b9-5994-45be-9dff-974ade973675 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:47.346374 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-11b7d9b9-5994-45be-9dff-974ade973675 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:47.347307 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-11b7d9b9-5994-45be-9dff-974ade973675 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:47.348135 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-11b7d9b9-5994-45be-9dff-974ade973675 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:47.348570 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-11b7d9b9-5994-45be-9dff-974ade973675 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:47.453070 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-11b7d9b9-5994-45be-9dff-974ade973675 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action" status: 200 len: 31032 microversion: 2.1 time: 0.123970 Nov 16 16:09:47.454446 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 450/875] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:09:47 2021] POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action => generated 31032 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:09:47.771085 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-e5461359-69c2-4f7c-9d68-b29c50daaeb5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:47.772395 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-e5461359-69c2-4f7c-9d68-b29c50daaeb5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:47.780750 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e5461359-69c2-4f7c-9d68-b29c50daaeb5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:47.781196 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e5461359-69c2-4f7c-9d68-b29c50daaeb5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:47.782176 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e5461359-69c2-4f7c-9d68-b29c50daaeb5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:47.782615 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e5461359-69c2-4f7c-9d68-b29c50daaeb5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:48.029861 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-e5461359-69c2-4f7c-9d68-b29c50daaeb5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:48.037897 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-e5461359-69c2-4f7c-9d68-b29c50daaeb5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:48.039745 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-e5461359-69c2-4f7c-9d68-b29c50daaeb5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:48.040829 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-e5461359-69c2-4f7c-9d68-b29c50daaeb5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 200 len: 1722 microversion: 2.20 time: 0.275633 Nov 16 16:09:48.041505 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 426/876] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:09:47 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 1722 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:09:48.466944 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d067a797-b995-47ab-98e9-7fc294f4fbd8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:48.468085 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d067a797-b995-47ab-98e9-7fc294f4fbd8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:48.474878 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d067a797-b995-47ab-98e9-7fc294f4fbd8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:48.475699 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d067a797-b995-47ab-98e9-7fc294f4fbd8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:48.476930 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d067a797-b995-47ab-98e9-7fc294f4fbd8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:48.477370 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d067a797-b995-47ab-98e9-7fc294f4fbd8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:48.548602 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d067a797-b995-47ab-98e9-7fc294f4fbd8 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action" status: 200 len: 32739 microversion: 2.1 time: 0.086739 Nov 16 16:09:48.550419 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 451/877] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:09:48 2021] POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action => generated 32739 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 16:09:49.060477 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-63659d03-c508-4d41-ad42-260abb2bc65a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:49.061276 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-63659d03-c508-4d41-ad42-260abb2bc65a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:49.068168 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-63659d03-c508-4d41-ad42-260abb2bc65a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:49.068625 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-63659d03-c508-4d41-ad42-260abb2bc65a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:49.069415 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-63659d03-c508-4d41-ad42-260abb2bc65a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:49.070531 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-63659d03-c508-4d41-ad42-260abb2bc65a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:49.204755 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-63659d03-c508-4d41-ad42-260abb2bc65a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:49.212762 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-63659d03-c508-4d41-ad42-260abb2bc65a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:49.214251 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-63659d03-c508-4d41-ad42-260abb2bc65a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:49.215609 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-63659d03-c508-4d41-ad42-260abb2bc65a tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 200 len: 1722 microversion: 2.20 time: 0.159449 Nov 16 16:09:49.216229 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 427/878] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:09:49 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:09:49.562727 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1d007cb0-fb8a-492b-a638-66da98690b8f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:49.563916 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1d007cb0-fb8a-492b-a638-66da98690b8f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:49.572019 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1d007cb0-fb8a-492b-a638-66da98690b8f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:49.572477 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1d007cb0-fb8a-492b-a638-66da98690b8f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:49.573283 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1d007cb0-fb8a-492b-a638-66da98690b8f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:49.573753 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1d007cb0-fb8a-492b-a638-66da98690b8f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:49.645901 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1d007cb0-fb8a-492b-a638-66da98690b8f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action" status: 200 len: 33578 microversion: 2.1 time: 0.086930 Nov 16 16:09:49.650217 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 452/879] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:09:49 2021] POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action => generated 33578 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:09:50.083037 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-03fd66f9-4186-45f8-8d68-bc9ef28b7bd2 req-1a4ffaac-8051-4e64-821e-cad2d80f94b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6af3cc97-b45c-4fde-9c9c-47a91dd69630", "name": "network-vif-unplugged", "status": "completed", "tag": "3d367ce8-61fa-49f0-b6d2-d3d025285525"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:50.084580 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:09:50.084580 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Nov 16 16:09:50.093013 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-03fd66f9-4186-45f8-8d68-bc9ef28b7bd2 req-1a4ffaac-8051-4e64-821e-cad2d80f94b4 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:50.093457 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-03fd66f9-4186-45f8-8d68-bc9ef28b7bd2 req-1a4ffaac-8051-4e64-821e-cad2d80f94b4 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:50.106261 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.compute.server_external_events [req-03fd66f9-4186-45f8-8d68-bc9ef28b7bd2 req-1a4ffaac-8051-4e64-821e-cad2d80f94b4 service nova] Unable to find a host for instance 6af3cc97-b45c-4fde-9c9c-47a91dd69630. Dropping event network-vif-unplugged {{(pid=116085) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 16 16:09:50.107141 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-03fd66f9-4186-45f8-8d68-bc9ef28b7bd2 req-1a4ffaac-8051-4e64-821e-cad2d80f94b4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027975 Nov 16 16:09:50.107990 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 428/880] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:09:50 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 16 16:09:50.234115 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-37ffd8ff-4727-405d-b02c-4ff957b227ab tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:50.234695 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-37ffd8ff-4727-405d-b02c-4ff957b227ab tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:50.241395 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-37ffd8ff-4727-405d-b02c-4ff957b227ab tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:50.243494 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-37ffd8ff-4727-405d-b02c-4ff957b227ab tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:50.244453 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-37ffd8ff-4727-405d-b02c-4ff957b227ab tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:50.244887 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-37ffd8ff-4727-405d-b02c-4ff957b227ab tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:50.390533 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-37ffd8ff-4727-405d-b02c-4ff957b227ab tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:50.400372 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-37ffd8ff-4727-405d-b02c-4ff957b227ab tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:50.402488 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-37ffd8ff-4727-405d-b02c-4ff957b227ab tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:50.403724 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-37ffd8ff-4727-405d-b02c-4ff957b227ab tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 200 len: 1665 microversion: 2.20 time: 0.173882 Nov 16 16:09:50.404300 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 453/881] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:09:50 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 1665 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:09:50.422312 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-5243bea2-7a02-47bc-9122-877756d7aeed tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3145bbcf-04da-4313-b2d7-f0902bf3a048"}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:50.423534 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-5243bea2-7a02-47bc-9122-877756d7aeed tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:50.430487 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5243bea2-7a02-47bc-9122-877756d7aeed tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:50.430940 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5243bea2-7a02-47bc-9122-877756d7aeed tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:50.431758 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5243bea2-7a02-47bc-9122-877756d7aeed tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:50.432193 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5243bea2-7a02-47bc-9122-877756d7aeed tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:50.658251 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c712ce76-1fdc-4b82-b0b4-e9e9b6383558 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:50.659335 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c712ce76-1fdc-4b82-b0b4-e9e9b6383558 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:50.666191 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c712ce76-1fdc-4b82-b0b4-e9e9b6383558 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:50.666760 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c712ce76-1fdc-4b82-b0b4-e9e9b6383558 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:50.667687 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c712ce76-1fdc-4b82-b0b4-e9e9b6383558 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:50.668219 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c712ce76-1fdc-4b82-b0b4-e9e9b6383558 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:50.726120 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-5243bea2-7a02-47bc-9122-877756d7aeed tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.302339 Nov 16 16:09:50.726120 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 429/882] 10.222.0.46 () {62 vars in 1363 bytes} [Tue Nov 16 16:09:50 2021] POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/os-volume_attachments => generated 188 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:09:50.751346 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c712ce76-1fdc-4b82-b0b4-e9e9b6383558 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action" status: 200 len: 34747 microversion: 2.1 time: 0.096489 Nov 16 16:09:50.752438 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 454/883] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:09:50 2021] POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action => generated 34747 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:09:50.846920 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-6f387307-3bcd-4b22-986e-7ea24e0f93ac tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:50.847409 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-6f387307-3bcd-4b22-986e-7ea24e0f93ac tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:50.853378 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6f387307-3bcd-4b22-986e-7ea24e0f93ac tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:50.853820 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6f387307-3bcd-4b22-986e-7ea24e0f93ac tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:50.854592 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6f387307-3bcd-4b22-986e-7ea24e0f93ac tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:50.855019 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6f387307-3bcd-4b22-986e-7ea24e0f93ac tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:51.106755 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-6f387307-3bcd-4b22-986e-7ea24e0f93ac tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/os-volume_attachments/3145bbcf-04da-4313-b2d7-f0902bf3a048" status: 202 len: 0 microversion: 2.20 time: 0.263402 Nov 16 16:09:51.110976 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 430/884] 10.222.0.46 () {60 vars in 1456 bytes} [Tue Nov 16 16:09:50 2021] DELETE /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/os-volume_attachments/3145bbcf-04da-4313-b2d7-f0902bf3a048 => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 16 16:09:51.166013 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b8849081-e053-4fbe-af6e-780cb8ff3fff tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:51.166674 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b8849081-e053-4fbe-af6e-780cb8ff3fff tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:51.173682 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b8849081-e053-4fbe-af6e-780cb8ff3fff tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:51.174218 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b8849081-e053-4fbe-af6e-780cb8ff3fff tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:51.175050 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b8849081-e053-4fbe-af6e-780cb8ff3fff tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:51.175601 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b8849081-e053-4fbe-af6e-780cb8ff3fff tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:51.383593 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b8849081-e053-4fbe-af6e-780cb8ff3fff tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action" status: 202 len: 0 microversion: 2.20 time: 0.221665 Nov 16 16:09:51.384220 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 455/885] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 16:09:51 2021] POST /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 16 16:09:51.392466 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-947fab4a-2e1f-4425-8eec-c58548dc91f3 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:51.393076 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-947fab4a-2e1f-4425-8eec-c58548dc91f3 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:51.404411 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-947fab4a-2e1f-4425-8eec-c58548dc91f3 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:51.405163 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-947fab4a-2e1f-4425-8eec-c58548dc91f3 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:51.406405 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-947fab4a-2e1f-4425-8eec-c58548dc91f3 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:51.407060 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-947fab4a-2e1f-4425-8eec-c58548dc91f3 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:51.552480 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-947fab4a-2e1f-4425-8eec-c58548dc91f3 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:51.561339 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-947fab4a-2e1f-4425-8eec-c58548dc91f3 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:51.563023 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-947fab4a-2e1f-4425-8eec-c58548dc91f3 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:51.564352 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-947fab4a-2e1f-4425-8eec-c58548dc91f3 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 200 len: 1673 microversion: 2.20 time: 0.175771 Nov 16 16:09:51.565150 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 431/886] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:09:51 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 1673 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:09:51.764599 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-93fe7a1b-b3db-45fe-8de5-ad8784e27870 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:51.765560 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-93fe7a1b-b3db-45fe-8de5-ad8784e27870 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:51.771414 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-93fe7a1b-b3db-45fe-8de5-ad8784e27870 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:51.771945 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-93fe7a1b-b3db-45fe-8de5-ad8784e27870 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:51.772761 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-93fe7a1b-b3db-45fe-8de5-ad8784e27870 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:51.773375 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-93fe7a1b-b3db-45fe-8de5-ad8784e27870 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:51.853892 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-93fe7a1b-b3db-45fe-8de5-ad8784e27870 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action" status: 200 len: 35983 microversion: 2.1 time: 0.093178 Nov 16 16:09:51.858163 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 456/887] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:09:51 2021] POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action => generated 35983 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:09:52.586948 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-5250156e-00c0-436c-9c48-7378d7d2a212 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:52.587864 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-5250156e-00c0-436c-9c48-7378d7d2a212 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:52.594568 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5250156e-00c0-436c-9c48-7378d7d2a212 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:52.594965 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5250156e-00c0-436c-9c48-7378d7d2a212 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:52.595845 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5250156e-00c0-436c-9c48-7378d7d2a212 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:52.596278 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5250156e-00c0-436c-9c48-7378d7d2a212 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:52.734104 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-5250156e-00c0-436c-9c48-7378d7d2a212 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:52.742045 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-5250156e-00c0-436c-9c48-7378d7d2a212 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:52.743567 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-5250156e-00c0-436c-9c48-7378d7d2a212 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:52.744738 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-5250156e-00c0-436c-9c48-7378d7d2a212 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 200 len: 1731 microversion: 2.20 time: 0.162754 Nov 16 16:09:52.745300 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 432/888] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:09:52 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:09:52.867633 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-38ab34a6-2986-4e0e-b659-808ee235b0f5 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:52.868986 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-38ab34a6-2986-4e0e-b659-808ee235b0f5 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:52.876644 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-38ab34a6-2986-4e0e-b659-808ee235b0f5 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:52.877511 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-38ab34a6-2986-4e0e-b659-808ee235b0f5 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:52.878314 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-38ab34a6-2986-4e0e-b659-808ee235b0f5 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:52.878916 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-38ab34a6-2986-4e0e-b659-808ee235b0f5 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:52.952050 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-38ab34a6-2986-4e0e-b659-808ee235b0f5 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action" status: 200 len: 37634 microversion: 2.1 time: 0.089107 Nov 16 16:09:52.952736 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 457/889] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:09:52 2021] POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action => generated 37634 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:09:53.763855 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-31a61d7c-c449-499a-aede-1fc82e634f4c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:53.764592 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-31a61d7c-c449-499a-aede-1fc82e634f4c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:53.779537 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-31a61d7c-c449-499a-aede-1fc82e634f4c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:53.780082 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-31a61d7c-c449-499a-aede-1fc82e634f4c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:53.780957 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-31a61d7c-c449-499a-aede-1fc82e634f4c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:53.781552 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-31a61d7c-c449-499a-aede-1fc82e634f4c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:53.965986 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-bc844503-dee0-4c4e-b30c-b25f3179a6f1 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:53.967799 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-bc844503-dee0-4c4e-b30c-b25f3179a6f1 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:53.975094 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bc844503-dee0-4c4e-b30c-b25f3179a6f1 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:53.976657 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bc844503-dee0-4c4e-b30c-b25f3179a6f1 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:53.977822 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bc844503-dee0-4c4e-b30c-b25f3179a6f1 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:53.978586 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bc844503-dee0-4c4e-b30c-b25f3179a6f1 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:53.992923 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-31a61d7c-c449-499a-aede-1fc82e634f4c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:54.002335 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-31a61d7c-c449-499a-aede-1fc82e634f4c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:54.003853 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-31a61d7c-c449-499a-aede-1fc82e634f4c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:54.005041 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-31a61d7c-c449-499a-aede-1fc82e634f4c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 200 len: 1731 microversion: 2.20 time: 0.245290 Nov 16 16:09:54.015496 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 433/890] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:09:53 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 1731 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:09:55.027293 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-a15fd5d4-6c22-496d-a6af-6d046b96b009 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:55.028004 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-a15fd5d4-6c22-496d-a6af-6d046b96b009 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:55.034371 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a15fd5d4-6c22-496d-a6af-6d046b96b009 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:55.034844 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a15fd5d4-6c22-496d-a6af-6d046b96b009 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:55.035669 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a15fd5d4-6c22-496d-a6af-6d046b96b009 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:55.036106 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a15fd5d4-6c22-496d-a6af-6d046b96b009 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:55.180707 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-a15fd5d4-6c22-496d-a6af-6d046b96b009 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:55.188414 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-a15fd5d4-6c22-496d-a6af-6d046b96b009 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:55.189933 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-a15fd5d4-6c22-496d-a6af-6d046b96b009 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:55.191086 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-a15fd5d4-6c22-496d-a6af-6d046b96b009 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 200 len: 1731 microversion: 2.20 time: 0.167860 Nov 16 16:09:55.191698 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 434/891] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:09:55 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:09:56.208964 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-6b0d12e2-f233-457f-aeec-755c3c0ab559 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:56.209666 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-6b0d12e2-f233-457f-aeec-755c3c0ab559 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:56.216150 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6b0d12e2-f233-457f-aeec-755c3c0ab559 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:56.216672 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6b0d12e2-f233-457f-aeec-755c3c0ab559 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:56.217526 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6b0d12e2-f233-457f-aeec-755c3c0ab559 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:56.218046 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6b0d12e2-f233-457f-aeec-755c3c0ab559 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:56.359299 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-6b0d12e2-f233-457f-aeec-755c3c0ab559 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:56.368206 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-6b0d12e2-f233-457f-aeec-755c3c0ab559 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:56.369630 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-6b0d12e2-f233-457f-aeec-755c3c0ab559 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:56.371824 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-6b0d12e2-f233-457f-aeec-755c3c0ab559 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 200 len: 1731 microversion: 2.20 time: 0.165785 Nov 16 16:09:56.383368 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 435/892] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:09:56 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:09:57.389969 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-6496f995-c603-4848-87e9-c5dd5c36aefb tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:57.390632 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-6496f995-c603-4848-87e9-c5dd5c36aefb tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:57.397167 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6496f995-c603-4848-87e9-c5dd5c36aefb tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:57.397608 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6496f995-c603-4848-87e9-c5dd5c36aefb tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:57.398393 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6496f995-c603-4848-87e9-c5dd5c36aefb tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:57.398827 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6496f995-c603-4848-87e9-c5dd5c36aefb tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:57.536639 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-6496f995-c603-4848-87e9-c5dd5c36aefb tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:57.544477 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-6496f995-c603-4848-87e9-c5dd5c36aefb tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:57.545974 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-6496f995-c603-4848-87e9-c5dd5c36aefb tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:57.547131 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-6496f995-c603-4848-87e9-c5dd5c36aefb tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 200 len: 1731 microversion: 2.20 time: 0.160854 Nov 16 16:09:57.547740 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 436/893] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:09:57 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:09:58.566077 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-0b888085-74be-423e-b1c1-0cfeef602ffd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:58.566823 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-0b888085-74be-423e-b1c1-0cfeef602ffd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:58.573943 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0b888085-74be-423e-b1c1-0cfeef602ffd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:58.574381 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0b888085-74be-423e-b1c1-0cfeef602ffd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:58.575165 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0b888085-74be-423e-b1c1-0cfeef602ffd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:58.575626 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0b888085-74be-423e-b1c1-0cfeef602ffd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:58.714187 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-0b888085-74be-423e-b1c1-0cfeef602ffd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:58.723260 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-0b888085-74be-423e-b1c1-0cfeef602ffd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:58.724930 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-0b888085-74be-423e-b1c1-0cfeef602ffd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:58.726766 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-0b888085-74be-423e-b1c1-0cfeef602ffd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 200 len: 1731 microversion: 2.20 time: 0.164339 Nov 16 16:09:58.727731 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 437/894] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:09:58 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:09:59.745286 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-29be38fc-02cb-4c5d-8100-cfa4b90c61f6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:59.747059 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-29be38fc-02cb-4c5d-8100-cfa4b90c61f6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:09:59.752655 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-29be38fc-02cb-4c5d-8100-cfa4b90c61f6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:59.753108 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-29be38fc-02cb-4c5d-8100-cfa4b90c61f6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:59.753897 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-29be38fc-02cb-4c5d-8100-cfa4b90c61f6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:09:59.754327 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-29be38fc-02cb-4c5d-8100-cfa4b90c61f6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:09:59.895325 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-29be38fc-02cb-4c5d-8100-cfa4b90c61f6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:59.904494 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-29be38fc-02cb-4c5d-8100-cfa4b90c61f6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:59.905964 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-29be38fc-02cb-4c5d-8100-cfa4b90c61f6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:09:59.907111 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-29be38fc-02cb-4c5d-8100-cfa4b90c61f6 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 200 len: 1731 microversion: 2.20 time: 0.166011 Nov 16 16:09:59.907690 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 438/895] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:09:59 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:10:00.925570 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-8f114a9a-9594-49a0-aa57-be41e386af12 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:10:00.926266 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-8f114a9a-9594-49a0-aa57-be41e386af12 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:10:00.933215 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8f114a9a-9594-49a0-aa57-be41e386af12 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:00.933558 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8f114a9a-9594-49a0-aa57-be41e386af12 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:00.934364 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8f114a9a-9594-49a0-aa57-be41e386af12 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:00.934836 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8f114a9a-9594-49a0-aa57-be41e386af12 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:01.076239 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-8f114a9a-9594-49a0-aa57-be41e386af12 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:10:01.087744 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-8f114a9a-9594-49a0-aa57-be41e386af12 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:10:01.089230 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-8f114a9a-9594-49a0-aa57-be41e386af12 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:10:01.091570 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-8f114a9a-9594-49a0-aa57-be41e386af12 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 200 len: 1731 microversion: 2.20 time: 0.169652 Nov 16 16:10:01.092139 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 439/896] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:10:00 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:10:02.109987 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-1e00ae10-9973-47f2-8fbe-723e0b4008c7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:10:02.111327 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-1e00ae10-9973-47f2-8fbe-723e0b4008c7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:10:02.118664 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1e00ae10-9973-47f2-8fbe-723e0b4008c7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:02.119222 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1e00ae10-9973-47f2-8fbe-723e0b4008c7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:02.120045 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1e00ae10-9973-47f2-8fbe-723e0b4008c7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:02.120478 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1e00ae10-9973-47f2-8fbe-723e0b4008c7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:02.256212 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-1e00ae10-9973-47f2-8fbe-723e0b4008c7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:10:02.264283 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-1e00ae10-9973-47f2-8fbe-723e0b4008c7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:10:02.265885 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-1e00ae10-9973-47f2-8fbe-723e0b4008c7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:10:02.267095 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-1e00ae10-9973-47f2-8fbe-723e0b4008c7 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 200 len: 1731 microversion: 2.20 time: 0.160730 Nov 16 16:10:02.267680 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 440/897] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:10:02 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:10:03.285945 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-563c2b0b-0fb1-4b22-8a86-673aa9d9232f tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:10:03.286712 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-563c2b0b-0fb1-4b22-8a86-673aa9d9232f tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:10:03.293086 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-563c2b0b-0fb1-4b22-8a86-673aa9d9232f tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:03.293536 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-563c2b0b-0fb1-4b22-8a86-673aa9d9232f tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:03.294326 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-563c2b0b-0fb1-4b22-8a86-673aa9d9232f tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:03.294757 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-563c2b0b-0fb1-4b22-8a86-673aa9d9232f tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:03.436177 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-563c2b0b-0fb1-4b22-8a86-673aa9d9232f tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:10:03.443850 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-563c2b0b-0fb1-4b22-8a86-673aa9d9232f tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:10:03.446547 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-563c2b0b-0fb1-4b22-8a86-673aa9d9232f tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:10:03.447850 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-563c2b0b-0fb1-4b22-8a86-673aa9d9232f tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 200 len: 1731 microversion: 2.20 time: 0.165519 Nov 16 16:10:03.448416 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 441/898] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:10:03 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:10:04.212486 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-bc844503-dee0-4c4e-b30c-b25f3179a6f1 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action" status: 200 len: 38314 microversion: 2.1 time: 10.250533 Nov 16 16:10:04.213145 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 458/899] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:09:53 2021] POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/action => generated 38314 bytes in 10253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 16:10:04.222764 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-cf41297f-8f21-4101-9734-6af6a6ec7c48 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:10:04.223356 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-cf41297f-8f21-4101-9734-6af6a6ec7c48 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:10:04.229414 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cf41297f-8f21-4101-9734-6af6a6ec7c48 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:04.229942 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cf41297f-8f21-4101-9734-6af6a6ec7c48 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:04.230796 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cf41297f-8f21-4101-9734-6af6a6ec7c48 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:04.231243 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cf41297f-8f21-4101-9734-6af6a6ec7c48 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:04.255141 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-cf41297f-8f21-4101-9734-6af6a6ec7c48 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/ips" status: 200 len: 143 microversion: 2.1 time: 0.035928 Nov 16 16:10:04.255758 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 442/900] 10.222.0.46 () {58 vars in 1247 bytes} [Tue Nov 16 16:10:04 2021] GET /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/ips => generated 143 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:10:04.470738 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d841b900-e005-48c1-a6b0-4ae3d990dddd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:10:04.471690 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d841b900-e005-48c1-a6b0-4ae3d990dddd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:10:04.494848 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d841b900-e005-48c1-a6b0-4ae3d990dddd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:04.495204 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d841b900-e005-48c1-a6b0-4ae3d990dddd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:04.496052 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d841b900-e005-48c1-a6b0-4ae3d990dddd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:04.496491 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d841b900-e005-48c1-a6b0-4ae3d990dddd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:04.646182 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d841b900-e005-48c1-a6b0-4ae3d990dddd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:10:04.654953 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d841b900-e005-48c1-a6b0-4ae3d990dddd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:10:04.656496 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d841b900-e005-48c1-a6b0-4ae3d990dddd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:10:04.657656 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d841b900-e005-48c1-a6b0-4ae3d990dddd tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 200 len: 1731 microversion: 2.20 time: 0.191157 Nov 16 16:10:04.658244 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 459/901] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:10:04 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 1731 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:10:05.571415 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-1dd48f9d-40db-41a5-a349-f0dd03806648 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88f10bfc-11ce-4585-9218-f8233f0638e3"}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:10:05.572562 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-1dd48f9d-40db-41a5-a349-f0dd03806648 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:10:05.578869 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1dd48f9d-40db-41a5-a349-f0dd03806648 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:05.579317 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1dd48f9d-40db-41a5-a349-f0dd03806648 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:05.580111 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1dd48f9d-40db-41a5-a349-f0dd03806648 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:05.580547 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1dd48f9d-40db-41a5-a349-f0dd03806648 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:05.678196 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7ece3197-1ba1-49c6-b4a5-ba9bc566f321 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:10:05.679527 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-7ece3197-1ba1-49c6-b4a5-ba9bc566f321 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:10:05.686363 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7ece3197-1ba1-49c6-b4a5-ba9bc566f321 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:05.686847 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7ece3197-1ba1-49c6-b4a5-ba9bc566f321 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:05.687780 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7ece3197-1ba1-49c6-b4a5-ba9bc566f321 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:05.688205 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7ece3197-1ba1-49c6-b4a5-ba9bc566f321 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:05.815906 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-1dd48f9d-40db-41a5-a349-f0dd03806648 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.248661 Nov 16 16:10:05.821718 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 443/902] 10.222.0.46 () {60 vars in 1322 bytes} [Tue Nov 16 16:10:05 2021] POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/os-volume_attachments => generated 194 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:10:05.845588 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7ece3197-1ba1-49c6-b4a5-ba9bc566f321 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:10:05.854232 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7ece3197-1ba1-49c6-b4a5-ba9bc566f321 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:10:05.855884 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7ece3197-1ba1-49c6-b4a5-ba9bc566f321 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:10:05.856968 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-7ece3197-1ba1-49c6-b4a5-ba9bc566f321 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 200 len: 1731 microversion: 2.20 time: 0.183117 Nov 16 16:10:05.857521 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 460/903] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:10:05 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 1731 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:10:06.876802 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-b064ee10-e08c-415f-8c2d-6305fbfc80ac tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:10:06.877602 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-b064ee10-e08c-415f-8c2d-6305fbfc80ac tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:10:06.883998 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b064ee10-e08c-415f-8c2d-6305fbfc80ac tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:06.884455 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b064ee10-e08c-415f-8c2d-6305fbfc80ac tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:06.885241 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b064ee10-e08c-415f-8c2d-6305fbfc80ac tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:06.885678 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b064ee10-e08c-415f-8c2d-6305fbfc80ac tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:07.018351 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-b064ee10-e08c-415f-8c2d-6305fbfc80ac tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:10:07.026445 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-b064ee10-e08c-415f-8c2d-6305fbfc80ac tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:10:07.027971 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-b064ee10-e08c-415f-8c2d-6305fbfc80ac tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:10:07.029126 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-b064ee10-e08c-415f-8c2d-6305fbfc80ac tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 200 len: 1731 microversion: 2.20 time: 0.156974 Nov 16 16:10:07.029686 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 444/904] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:10:06 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:10:08.048038 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ab71e0b7-019c-4d1a-9b79-4ef3d0fab24d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:10:08.048636 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ab71e0b7-019c-4d1a-9b79-4ef3d0fab24d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:10:08.055392 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ab71e0b7-019c-4d1a-9b79-4ef3d0fab24d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:08.056036 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ab71e0b7-019c-4d1a-9b79-4ef3d0fab24d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:08.056803 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ab71e0b7-019c-4d1a-9b79-4ef3d0fab24d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:08.057249 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ab71e0b7-019c-4d1a-9b79-4ef3d0fab24d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:08.197299 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ab71e0b7-019c-4d1a-9b79-4ef3d0fab24d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:10:08.209161 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ab71e0b7-019c-4d1a-9b79-4ef3d0fab24d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:10:08.211651 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ab71e0b7-019c-4d1a-9b79-4ef3d0fab24d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:10:08.213837 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ab71e0b7-019c-4d1a-9b79-4ef3d0fab24d tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 200 len: 1731 microversion: 2.20 time: 0.168880 Nov 16 16:10:08.227262 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 461/905] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:10:08 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:10:08.266114 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-e2ee0e29-8c62-484e-b97d-638ee5405498 req-565fb0c0-c68f-488e-a108-d8b8b324590e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6af3cc97-b45c-4fde-9c9c-47a91dd69630", "name": "network-vif-plugged", "status": "completed", "tag": "3d367ce8-61fa-49f0-b6d2-d3d025285525"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:10:08.269599 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:10:08.269599 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Nov 16 16:10:08.277812 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-e2ee0e29-8c62-484e-b97d-638ee5405498 req-565fb0c0-c68f-488e-a108-d8b8b324590e service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:08.278258 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-e2ee0e29-8c62-484e-b97d-638ee5405498 req-565fb0c0-c68f-488e-a108-d8b8b324590e service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:08.289570 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-e2ee0e29-8c62-484e-b97d-638ee5405498 req-565fb0c0-c68f-488e-a108-d8b8b324590e service nova] Creating event network-vif-plugged:3d367ce8-61fa-49f0-b6d2-d3d025285525 for instance 6af3cc97-b45c-4fde-9c9c-47a91dd69630 on hv-cinder-81809 Nov 16 16:10:08.294259 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-e2ee0e29-8c62-484e-b97d-638ee5405498 req-565fb0c0-c68f-488e-a108-d8b8b324590e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032202 Nov 16 16:10:08.294913 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 445/906] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:10:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:10:09.232764 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-74b02823-681d-460a-bc71-db21e7d6891c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:10:09.233375 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-74b02823-681d-460a-bc71-db21e7d6891c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:10:09.240058 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-74b02823-681d-460a-bc71-db21e7d6891c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:09.240504 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-74b02823-681d-460a-bc71-db21e7d6891c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:09.241314 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-74b02823-681d-460a-bc71-db21e7d6891c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:09.241751 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-74b02823-681d-460a-bc71-db21e7d6891c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:09.374516 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-74b02823-681d-460a-bc71-db21e7d6891c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:10:09.383179 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-74b02823-681d-460a-bc71-db21e7d6891c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:10:09.384700 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-74b02823-681d-460a-bc71-db21e7d6891c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:10:09.385848 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-74b02823-681d-460a-bc71-db21e7d6891c tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 200 len: 1731 microversion: 2.20 time: 0.157079 Nov 16 16:10:09.386398 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 462/907] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:10:09 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:10:10.404125 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-ec2d269e-3b31-428b-a7d9-9e7064a4ddf0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:10:10.404852 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-ec2d269e-3b31-428b-a7d9-9e7064a4ddf0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:10:10.410946 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ec2d269e-3b31-428b-a7d9-9e7064a4ddf0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:10.411393 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ec2d269e-3b31-428b-a7d9-9e7064a4ddf0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:10.412183 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ec2d269e-3b31-428b-a7d9-9e7064a4ddf0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:10.412614 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ec2d269e-3b31-428b-a7d9-9e7064a4ddf0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:10.548090 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-ec2d269e-3b31-428b-a7d9-9e7064a4ddf0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:10:10.556503 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-ec2d269e-3b31-428b-a7d9-9e7064a4ddf0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:10:10.557983 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-ec2d269e-3b31-428b-a7d9-9e7064a4ddf0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:10:10.559130 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-ec2d269e-3b31-428b-a7d9-9e7064a4ddf0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 200 len: 1718 microversion: 2.20 time: 0.159801 Nov 16 16:10:10.559722 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 446/908] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:10:10 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 1718 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:10:12.230025 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-9d71cc35-0854-4a6d-b31d-200f0d39a8a5 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:10:12.230942 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-9d71cc35-0854-4a6d-b31d-200f0d39a8a5 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:10:12.237209 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9d71cc35-0854-4a6d-b31d-200f0d39a8a5 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:12.237660 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9d71cc35-0854-4a6d-b31d-200f0d39a8a5 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:12.238439 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9d71cc35-0854-4a6d-b31d-200f0d39a8a5 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:12.238880 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9d71cc35-0854-4a6d-b31d-200f0d39a8a5 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:12.267313 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-9d71cc35-0854-4a6d-b31d-200f0d39a8a5 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041542 Nov 16 16:10:12.267841 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 463/909] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 16 16:10:12 2021] GET /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:10:12.277750 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-c8f7ef70-5bf8-4144-8aaf-b076bbb807b3 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:10:12.278242 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-c8f7ef70-5bf8-4144-8aaf-b076bbb807b3 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:10:12.284768 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c8f7ef70-5bf8-4144-8aaf-b076bbb807b3 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:12.285212 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c8f7ef70-5bf8-4144-8aaf-b076bbb807b3 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:12.285979 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c8f7ef70-5bf8-4144-8aaf-b076bbb807b3 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:12.286439 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c8f7ef70-5bf8-4144-8aaf-b076bbb807b3 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:12.315088 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-c8f7ef70-5bf8-4144-8aaf-b076bbb807b3 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/os-volume_attachments/88f10bfc-11ce-4585-9218-f8233f0638e3" status: 200 len: 194 microversion: 2.1 time: 0.041507 Nov 16 16:10:12.315676 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 447/910] 10.222.0.46 () {58 vars in 1412 bytes} [Tue Nov 16 16:10:12 2021] GET /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/os-volume_attachments/88f10bfc-11ce-4585-9218-f8233f0638e3 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:10:13.645721 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ad680457-9c6b-46ec-ac42-0f27517a7c9d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e87cbeaf-47dd-460d-9170-b786902b324c"}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:10:13.646748 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ad680457-9c6b-46ec-ac42-0f27517a7c9d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:10:13.654446 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ad680457-9c6b-46ec-ac42-0f27517a7c9d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:13.654888 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ad680457-9c6b-46ec-ac42-0f27517a7c9d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:13.655762 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ad680457-9c6b-46ec-ac42-0f27517a7c9d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:13.656191 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ad680457-9c6b-46ec-ac42-0f27517a7c9d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:13.914705 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ad680457-9c6b-46ec-ac42-0f27517a7c9d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272514 Nov 16 16:10:13.915335 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 464/911] 10.222.0.46 () {60 vars in 1322 bytes} [Tue Nov 16 16:10:13 2021] POST /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:10:21.375380 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-7ce2aeae-5183-4f41-8f0e-d467eb96c15c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:10:21.376403 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-7ce2aeae-5183-4f41-8f0e-d467eb96c15c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:10:21.383508 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7ce2aeae-5183-4f41-8f0e-d467eb96c15c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:21.383979 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7ce2aeae-5183-4f41-8f0e-d467eb96c15c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:21.384753 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7ce2aeae-5183-4f41-8f0e-d467eb96c15c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:21.385184 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7ce2aeae-5183-4f41-8f0e-d467eb96c15c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:21.413949 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-7ce2aeae-5183-4f41-8f0e-d467eb96c15c tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042385 Nov 16 16:10:21.414504 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 448/912] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 16 16:10:21 2021] GET /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:10:21.638975 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d0167382-f40d-49cc-95ae-863a286ab42d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:10:21.639568 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d0167382-f40d-49cc-95ae-863a286ab42d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:10:21.645658 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d0167382-f40d-49cc-95ae-863a286ab42d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:21.646099 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d0167382-f40d-49cc-95ae-863a286ab42d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:21.646863 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d0167382-f40d-49cc-95ae-863a286ab42d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:21.647290 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d0167382-f40d-49cc-95ae-863a286ab42d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:21.675359 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d0167382-f40d-49cc-95ae-863a286ab42d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/os-volume_attachments/88f10bfc-11ce-4585-9218-f8233f0638e3" status: 200 len: 194 microversion: 2.1 time: 0.041054 Nov 16 16:10:21.675975 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 465/913] 10.222.0.46 () {58 vars in 1412 bytes} [Tue Nov 16 16:10:21 2021] GET /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/os-volume_attachments/88f10bfc-11ce-4585-9218-f8233f0638e3 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:10:21.686227 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-7b5a7416-59db-456b-9134-055f169a39b6 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:10:21.686716 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-7b5a7416-59db-456b-9134-055f169a39b6 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:10:21.692512 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7b5a7416-59db-456b-9134-055f169a39b6 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:21.692953 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7b5a7416-59db-456b-9134-055f169a39b6 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:21.693722 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7b5a7416-59db-456b-9134-055f169a39b6 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:21.694155 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7b5a7416-59db-456b-9134-055f169a39b6 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:21.771875 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.objects.instance [None req-7b5a7416-59db-456b-9134-055f169a39b6 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lazy-loading 'services' on Instance uuid 6001444a-6dd4-41b0-b53f-eb0c1537cf69 {{(pid=116085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:10:21.842147 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-7b5a7416-59db-456b-9134-055f169a39b6 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/os-volume_attachments/88f10bfc-11ce-4585-9218-f8233f0638e3" status: 202 len: 0 microversion: 2.1 time: 0.159406 Nov 16 16:10:21.842798 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 449/914] 10.222.0.46 () {58 vars in 1415 bytes} [Tue Nov 16 16:10:21 2021] DELETE /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/os-volume_attachments/88f10bfc-11ce-4585-9218-f8233f0638e3 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:10:22.948015 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b5a0045c-f74d-40b9-bb7f-6ad45b69a06d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:10:22.948534 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b5a0045c-f74d-40b9-bb7f-6ad45b69a06d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:10:22.954625 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b5a0045c-f74d-40b9-bb7f-6ad45b69a06d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:22.955065 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b5a0045c-f74d-40b9-bb7f-6ad45b69a06d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:22.955860 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b5a0045c-f74d-40b9-bb7f-6ad45b69a06d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:22.956292 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b5a0045c-f74d-40b9-bb7f-6ad45b69a06d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:22.984338 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b5a0045c-f74d-40b9-bb7f-6ad45b69a06d tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/os-volume_attachments/e87cbeaf-47dd-460d-9170-b786902b324c" status: 200 len: 194 microversion: 2.1 time: 0.040686 Nov 16 16:10:22.984843 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 466/915] 10.222.0.46 () {58 vars in 1412 bytes} [Tue Nov 16 16:10:22 2021] GET /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/os-volume_attachments/e87cbeaf-47dd-460d-9170-b786902b324c => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:10:22.996139 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-ab5b991a-8d8d-4239-8c80-2da577d4ceca tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:10:22.996721 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-ab5b991a-8d8d-4239-8c80-2da577d4ceca tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:10:23.002688 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ab5b991a-8d8d-4239-8c80-2da577d4ceca tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:23.003137 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ab5b991a-8d8d-4239-8c80-2da577d4ceca tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:23.003946 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ab5b991a-8d8d-4239-8c80-2da577d4ceca tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:23.004377 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ab5b991a-8d8d-4239-8c80-2da577d4ceca tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:23.081849 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.objects.instance [None req-ab5b991a-8d8d-4239-8c80-2da577d4ceca tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lazy-loading 'services' on Instance uuid 6001444a-6dd4-41b0-b53f-eb0c1537cf69 {{(pid=116085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:10:23.151101 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-ab5b991a-8d8d-4239-8c80-2da577d4ceca tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/os-volume_attachments/e87cbeaf-47dd-460d-9170-b786902b324c" status: 202 len: 0 microversion: 2.1 time: 0.159892 Nov 16 16:10:23.151752 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 450/916] 10.222.0.46 () {58 vars in 1415 bytes} [Tue Nov 16 16:10:22 2021] DELETE /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/os-volume_attachments/e87cbeaf-47dd-460d-9170-b786902b324c => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:10:24.302374 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6db0cd6b-de69-4261-acca-d1cbc7ca2284 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:10:24.303383 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-6db0cd6b-de69-4261-acca-d1cbc7ca2284 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:10:24.310222 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6db0cd6b-de69-4261-acca-d1cbc7ca2284 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:24.310666 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6db0cd6b-de69-4261-acca-d1cbc7ca2284 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:24.311439 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6db0cd6b-de69-4261-acca-d1cbc7ca2284 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:24.311907 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6db0cd6b-de69-4261-acca-d1cbc7ca2284 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:24.341278 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-6db0cd6b-de69-4261-acca-d1cbc7ca2284 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042658 Nov 16 16:10:24.341820 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 467/917] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 16 16:10:24 2021] GET /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 16:10:24.443150 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-58ecd47c-3055-4db2-897b-92dd428711ac tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:10:24.444277 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-58ecd47c-3055-4db2-897b-92dd428711ac tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:10:24.450967 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-58ecd47c-3055-4db2-897b-92dd428711ac tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:24.451406 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-58ecd47c-3055-4db2-897b-92dd428711ac tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:24.452194 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-58ecd47c-3055-4db2-897b-92dd428711ac tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:24.452622 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-58ecd47c-3055-4db2-897b-92dd428711ac tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:24.481720 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-58ecd47c-3055-4db2-897b-92dd428711ac tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042985 Nov 16 16:10:24.482483 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 451/918] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 16 16:10:24 2021] GET /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 16:10:24.544036 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-860d6004-1405-44d1-915b-84a01aef6dc5 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:10:24.544534 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-860d6004-1405-44d1-915b-84a01aef6dc5 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:10:24.550329 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-860d6004-1405-44d1-915b-84a01aef6dc5 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:24.550779 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-860d6004-1405-44d1-915b-84a01aef6dc5 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:24.551586 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-860d6004-1405-44d1-915b-84a01aef6dc5 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:24.552025 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-860d6004-1405-44d1-915b-84a01aef6dc5 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:24.576050 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-860d6004-1405-44d1-915b-84a01aef6dc5 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Going to try to terminate instance {{(pid=116084) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 16:10:24.656182 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-860d6004-1405-44d1-915b-84a01aef6dc5 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69" status: 204 len: 0 microversion: 2.1 time: 0.116364 Nov 16 16:10:24.656848 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 468/919] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 16 16:10:24 2021] DELETE /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 16:10:24.665183 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-fd9a5ed9-725a-4e57-9544-b7c63089e624 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:10:24.665784 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-fd9a5ed9-725a-4e57-9544-b7c63089e624 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:10:24.672510 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fd9a5ed9-725a-4e57-9544-b7c63089e624 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:24.672951 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fd9a5ed9-725a-4e57-9544-b7c63089e624 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:24.673712 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fd9a5ed9-725a-4e57-9544-b7c63089e624 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:24.674137 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fd9a5ed9-725a-4e57-9544-b7c63089e624 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:24.816921 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-fd9a5ed9-725a-4e57-9544-b7c63089e624 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:10:24.824473 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-fd9a5ed9-725a-4e57-9544-b7c63089e624 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69" status: 200 len: 1671 microversion: 2.1 time: 0.162930 Nov 16 16:10:24.825187 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 452/920] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:10:24 2021] GET /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69 => generated 1671 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:10:25.841523 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-51547d42-7dda-45e0-9e2c-32c688e710f0 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:10:25.842219 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-51547d42-7dda-45e0-9e2c-32c688e710f0 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:10:25.848527 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-51547d42-7dda-45e0-9e2c-32c688e710f0 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:25.848977 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-51547d42-7dda-45e0-9e2c-32c688e710f0 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:25.849753 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-51547d42-7dda-45e0-9e2c-32c688e710f0 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:25.850291 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-51547d42-7dda-45e0-9e2c-32c688e710f0 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:25.982341 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-51547d42-7dda-45e0-9e2c-32c688e710f0 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:10:25.989865 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-51547d42-7dda-45e0-9e2c-32c688e710f0 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69" status: 200 len: 1671 microversion: 2.1 time: 0.152634 Nov 16 16:10:25.990438 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 469/921] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:10:25 2021] GET /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69 => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:10:27.007135 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-0c812b62-9153-4962-839e-7cc01ea92078 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:10:27.007743 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-0c812b62-9153-4962-839e-7cc01ea92078 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:10:27.014761 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0c812b62-9153-4962-839e-7cc01ea92078 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:27.015212 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0c812b62-9153-4962-839e-7cc01ea92078 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:27.016027 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0c812b62-9153-4962-839e-7cc01ea92078 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:27.016468 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0c812b62-9153-4962-839e-7cc01ea92078 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:27.157318 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-0c812b62-9153-4962-839e-7cc01ea92078 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:10:27.164712 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-0c812b62-9153-4962-839e-7cc01ea92078 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69" status: 200 len: 1671 microversion: 2.1 time: 0.161263 Nov 16 16:10:27.165280 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 453/922] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:10:27 2021] GET /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69 => generated 1671 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:10:27.805717 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-8ea43e41-949e-47ea-8253-5e368d184688 req-d5ff5c0f-550d-4f05-a25d-5b8ca9366117 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6001444a-6dd4-41b0-b53f-eb0c1537cf69", "name": "network-vif-deleted", "tag": "f73b554b-5d47-43fc-9731-138b41f213ad"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:10:27.808584 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:10:27.808584 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Nov 16 16:10:27.818515 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-8ea43e41-949e-47ea-8253-5e368d184688 req-d5ff5c0f-550d-4f05-a25d-5b8ca9366117 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:27.819303 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-8ea43e41-949e-47ea-8253-5e368d184688 req-d5ff5c0f-550d-4f05-a25d-5b8ca9366117 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:27.831935 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-8ea43e41-949e-47ea-8253-5e368d184688 req-d5ff5c0f-550d-4f05-a25d-5b8ca9366117 service nova] Creating event network-vif-deleted:f73b554b-5d47-43fc-9731-138b41f213ad for instance 6001444a-6dd4-41b0-b53f-eb0c1537cf69 on hv-cinder-81809 Nov 16 16:10:27.837345 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-8ea43e41-949e-47ea-8253-5e368d184688 req-d5ff5c0f-550d-4f05-a25d-5b8ca9366117 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035488 Nov 16 16:10:27.839788 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 470/923] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:10:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:10:28.182955 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-896111f7-8e03-4397-8ec5-7e40580857a3 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:10:28.184316 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-896111f7-8e03-4397-8ec5-7e40580857a3 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:10:28.191304 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-896111f7-8e03-4397-8ec5-7e40580857a3 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:28.191843 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-896111f7-8e03-4397-8ec5-7e40580857a3 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:28.192627 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-896111f7-8e03-4397-8ec5-7e40580857a3 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:28.193061 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-896111f7-8e03-4397-8ec5-7e40580857a3 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:28.231021 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-896111f7-8e03-4397-8ec5-7e40580857a3 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:28.231602 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-896111f7-8e03-4397-8ec5-7e40580857a3 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:28.232354 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.objects.instance [None req-896111f7-8e03-4397-8ec5-7e40580857a3 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lazy-loading 'fault' on Instance uuid 6001444a-6dd4-41b0-b53f-eb0c1537cf69 {{(pid=116085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:10:28.277953 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-896111f7-8e03-4397-8ec5-7e40580857a3 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2b32db732d2490986e5b70a861de30c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b827321a45f5478a8bd7953ed7be64b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:10:28.285461 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-896111f7-8e03-4397-8ec5-7e40580857a3 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69" status: 200 len: 1327 microversion: 2.1 time: 0.106518 Nov 16 16:10:28.286063 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 454/924] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:10:28 2021] GET /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69 => generated 1327 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:10:29.303179 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-22274c3b-680e-407e-8c8e-f47c3f3872fe tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:10:29.303897 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-22274c3b-680e-407e-8c8e-f47c3f3872fe tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:10:29.310920 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-22274c3b-680e-407e-8c8e-f47c3f3872fe tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:29.311372 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-22274c3b-680e-407e-8c8e-f47c3f3872fe tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:29.312172 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-22274c3b-680e-407e-8c8e-f47c3f3872fe tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:29.312609 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-22274c3b-680e-407e-8c8e-f47c3f3872fe tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:29.325885 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-22274c3b-680e-407e-8c8e-f47c3f3872fe tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] HTTP exception thrown: Instance 6001444a-6dd4-41b0-b53f-eb0c1537cf69 could not be found. Nov 16 16:10:29.326525 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-22274c3b-680e-407e-8c8e-f47c3f3872fe tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Returning 404 to user: Instance 6001444a-6dd4-41b0-b53f-eb0c1537cf69 could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:10:29.327345 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-22274c3b-680e-407e-8c8e-f47c3f3872fe tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69" status: 404 len: 111 microversion: 2.1 time: 0.028202 Nov 16 16:10:29.327895 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 471/925] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:10:29 2021] GET /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 16 16:10:29.335954 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-339e0ce8-3ba5-4535-8442-e7981d2fe3a3 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '.version_select at 0x7f113c28fc10>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:10:29.352407 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-339e0ce8-3ba5-4535-8442-e7981d2fe3a3 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1913773243" status: 202 len: 0 microversion: 2.1 time: 0.020075 Nov 16 16:10:29.352963 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 455/926] 10.222.0.46 () {58 vars in 1220 bytes} [Tue Nov 16 16:10:29 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1913773243 => generated 0 bytes in 21 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:10:32.222812 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e15583ce-4b53-4d36-bdd1-272e6a927a99 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:10:32.223293 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e15583ce-4b53-4d36-bdd1-272e6a927a99 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:10:32.230426 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e15583ce-4b53-4d36-bdd1-272e6a927a99 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:32.230876 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e15583ce-4b53-4d36-bdd1-272e6a927a99 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:32.231702 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e15583ce-4b53-4d36-bdd1-272e6a927a99 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:32.232136 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e15583ce-4b53-4d36-bdd1-272e6a927a99 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:32.245378 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-e15583ce-4b53-4d36-bdd1-272e6a927a99 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] HTTP exception thrown: Instance 6001444a-6dd4-41b0-b53f-eb0c1537cf69 could not be found. Nov 16 16:10:32.245955 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e15583ce-4b53-4d36-bdd1-272e6a927a99 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Returning 404 to user: Instance 6001444a-6dd4-41b0-b53f-eb0c1537cf69 could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:10:32.246770 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e15583ce-4b53-4d36-bdd1-272e6a927a99 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69" status: 404 len: 111 microversion: 2.1 time: 0.027599 Nov 16 16:10:32.247295 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 472/927] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 16 16:10:32 2021] DELETE /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:10:32.255375 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-458e33e6-1f61-4496-8b88-ab1d3a9c6d61 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:10:32.256023 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-458e33e6-1f61-4496-8b88-ab1d3a9c6d61 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 6001444a-6dd4-41b0-b53f-eb0c1537cf69] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:10:32.263067 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-458e33e6-1f61-4496-8b88-ab1d3a9c6d61 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:32.263525 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-458e33e6-1f61-4496-8b88-ab1d3a9c6d61 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:32.264296 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-458e33e6-1f61-4496-8b88-ab1d3a9c6d61 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:32.264735 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-458e33e6-1f61-4496-8b88-ab1d3a9c6d61 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:32.278427 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.wsgi [None req-458e33e6-1f61-4496-8b88-ab1d3a9c6d61 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] HTTP exception thrown: Instance 6001444a-6dd4-41b0-b53f-eb0c1537cf69 could not be found. Nov 16 16:10:32.278999 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-458e33e6-1f61-4496-8b88-ab1d3a9c6d61 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Returning 404 to user: Instance 6001444a-6dd4-41b0-b53f-eb0c1537cf69 could not be found. {{(pid=116085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:10:32.279832 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-458e33e6-1f61-4496-8b88-ab1d3a9c6d61 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69" status: 404 len: 111 microversion: 2.1 time: 0.028504 Nov 16 16:10:32.280353 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 456/928] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:10:32 2021] GET /compute/v2.1/servers/6001444a-6dd4-41b0-b53f-eb0c1537cf69 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:10:33.405197 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f8d18803-a0ea-4ed3-86ac-8bf75f2b4d3f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:10:33.405694 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f8d18803-a0ea-4ed3-86ac-8bf75f2b4d3f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:10:33.411938 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f8d18803-a0ea-4ed3-86ac-8bf75f2b4d3f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:33.412392 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f8d18803-a0ea-4ed3-86ac-8bf75f2b4d3f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:33.413175 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f8d18803-a0ea-4ed3-86ac-8bf75f2b4d3f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:33.413616 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f8d18803-a0ea-4ed3-86ac-8bf75f2b4d3f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:33.427074 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-f8d18803-a0ea-4ed3-86ac-8bf75f2b4d3f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] HTTP exception thrown: Instance 674c9e04-e56c-4891-adc1-7cdac0c8510f could not be found. Nov 16 16:10:33.427684 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f8d18803-a0ea-4ed3-86ac-8bf75f2b4d3f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Returning 404 to user: Instance 674c9e04-e56c-4891-adc1-7cdac0c8510f could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:10:33.428498 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f8d18803-a0ea-4ed3-86ac-8bf75f2b4d3f tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "DELETE /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 404 len: 111 microversion: 2.1 time: 0.026943 Nov 16 16:10:33.429022 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 473/929] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 16 16:10:33 2021] DELETE /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:10:33.437863 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-321cd138-bbaa-4262-9f4a-7124780ec4f9 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:10:33.438483 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-321cd138-bbaa-4262-9f4a-7124780ec4f9 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] [instance: 674c9e04-e56c-4891-adc1-7cdac0c8510f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:10:33.444701 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-321cd138-bbaa-4262-9f4a-7124780ec4f9 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:33.445147 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-321cd138-bbaa-4262-9f4a-7124780ec4f9 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:33.445912 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-321cd138-bbaa-4262-9f4a-7124780ec4f9 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:33.446346 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-321cd138-bbaa-4262-9f4a-7124780ec4f9 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:33.459150 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.wsgi [None req-321cd138-bbaa-4262-9f4a-7124780ec4f9 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] HTTP exception thrown: Instance 674c9e04-e56c-4891-adc1-7cdac0c8510f could not be found. Nov 16 16:10:33.459759 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-321cd138-bbaa-4262-9f4a-7124780ec4f9 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] Returning 404 to user: Instance 674c9e04-e56c-4891-adc1-7cdac0c8510f could not be found. {{(pid=116085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:10:33.460560 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-321cd138-bbaa-4262-9f4a-7124780ec4f9 tempest-AttachVolumeTestJSON-1178810914 tempest-AttachVolumeTestJSON-1178810914-project] 10.222.0.46 "GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f" status: 404 len: 111 microversion: 2.1 time: 0.026773 Nov 16 16:10:33.461079 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 457/930] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:10:33 2021] GET /compute/v2.1/servers/674c9e04-e56c-4891-adc1-7cdac0c8510f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:10:43.589662 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-59f7c79d-e7d2-46dd-96d2-bd3193b8a465 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:10:43.590645 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-59f7c79d-e7d2-46dd-96d2-bd3193b8a465 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:10:43.596944 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-59f7c79d-e7d2-46dd-96d2-bd3193b8a465 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:43.597394 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-59f7c79d-e7d2-46dd-96d2-bd3193b8a465 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:43.598175 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-59f7c79d-e7d2-46dd-96d2-bd3193b8a465 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:43.598614 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-59f7c79d-e7d2-46dd-96d2-bd3193b8a465 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:43.637701 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-59f7c79d-e7d2-46dd-96d2-bd3193b8a465 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047885 Nov 16 16:10:43.637701 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 474/931] 10.222.0.46 () {60 vars in 1342 bytes} [Tue Nov 16 16:10:43 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:10:43.690728 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-4b5fa269-62d6-4a65-b063-38c2b55815e0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:10:43.691289 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-4b5fa269-62d6-4a65-b063-38c2b55815e0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:10:43.697638 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4b5fa269-62d6-4a65-b063-38c2b55815e0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:43.698083 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4b5fa269-62d6-4a65-b063-38c2b55815e0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:43.698890 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4b5fa269-62d6-4a65-b063-38c2b55815e0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:43.699321 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4b5fa269-62d6-4a65-b063-38c2b55815e0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:43.725394 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-4b5fa269-62d6-4a65-b063-38c2b55815e0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Going to try to terminate instance {{(pid=116085) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 16:10:43.814248 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-4b5fa269-62d6-4a65-b063-38c2b55815e0 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 204 len: 0 microversion: 2.20 time: 0.126856 Nov 16 16:10:43.814843 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 458/932] 10.222.0.46 () {60 vars in 1279 bytes} [Tue Nov 16 16:10:43 2021] DELETE /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 16 16:10:43.823381 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e1778510-e90b-4659-b933-3ba412a10a2e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:10:43.824038 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e1778510-e90b-4659-b933-3ba412a10a2e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:10:43.830246 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e1778510-e90b-4659-b933-3ba412a10a2e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:43.830696 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e1778510-e90b-4659-b933-3ba412a10a2e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:43.831554 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e1778510-e90b-4659-b933-3ba412a10a2e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:43.831941 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e1778510-e90b-4659-b933-3ba412a10a2e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:43.969331 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e1778510-e90b-4659-b933-3ba412a10a2e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:10:43.977236 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e1778510-e90b-4659-b933-3ba412a10a2e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:10:43.979413 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e1778510-e90b-4659-b933-3ba412a10a2e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:10:43.980614 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e1778510-e90b-4659-b933-3ba412a10a2e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 200 len: 1724 microversion: 2.20 time: 0.161469 Nov 16 16:10:43.981173 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 475/933] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:10:43 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:10:45.001066 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-5104613e-b922-49b3-9888-5a6dbaf0dd6b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:10:45.001781 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-5104613e-b922-49b3-9888-5a6dbaf0dd6b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:10:45.008284 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5104613e-b922-49b3-9888-5a6dbaf0dd6b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:45.008728 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5104613e-b922-49b3-9888-5a6dbaf0dd6b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:45.010848 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5104613e-b922-49b3-9888-5a6dbaf0dd6b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:45.011478 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5104613e-b922-49b3-9888-5a6dbaf0dd6b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:45.146169 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-5104613e-b922-49b3-9888-5a6dbaf0dd6b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:10:45.154674 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-5104613e-b922-49b3-9888-5a6dbaf0dd6b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:10:45.159866 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-5104613e-b922-49b3-9888-5a6dbaf0dd6b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:10:45.161077 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-5104613e-b922-49b3-9888-5a6dbaf0dd6b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 200 len: 1724 microversion: 2.20 time: 0.164087 Nov 16 16:10:45.161637 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 459/934] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:10:44 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:10:46.027778 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-f6d87530-80d7-49ed-a48f-feb0fee1ea74 req-f071cc38-0e3b-4e2d-8071-9daee8889c8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6af3cc97-b45c-4fde-9c9c-47a91dd69630", "name": "network-vif-deleted", "tag": "3d367ce8-61fa-49f0-b6d2-d3d025285525"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:10:46.029733 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:10:46.029733 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Nov 16 16:10:46.041676 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-f6d87530-80d7-49ed-a48f-feb0fee1ea74 req-f071cc38-0e3b-4e2d-8071-9daee8889c8b service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:46.042770 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-f6d87530-80d7-49ed-a48f-feb0fee1ea74 req-f071cc38-0e3b-4e2d-8071-9daee8889c8b service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:46.057930 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-f6d87530-80d7-49ed-a48f-feb0fee1ea74 req-f071cc38-0e3b-4e2d-8071-9daee8889c8b service nova] Creating event network-vif-deleted:3d367ce8-61fa-49f0-b6d2-d3d025285525 for instance 6af3cc97-b45c-4fde-9c9c-47a91dd69630 on hv-cinder-81809 Nov 16 16:10:46.063926 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-f6d87530-80d7-49ed-a48f-feb0fee1ea74 req-f071cc38-0e3b-4e2d-8071-9daee8889c8b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040411 Nov 16 16:10:46.066428 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 476/935] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:10:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:10:46.179706 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-a24c6020-40be-4d43-bf42-0f4284fc077e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:10:46.180331 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-a24c6020-40be-4d43-bf42-0f4284fc077e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:10:46.190338 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a24c6020-40be-4d43-bf42-0f4284fc077e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:46.191048 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a24c6020-40be-4d43-bf42-0f4284fc077e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:46.197432 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a24c6020-40be-4d43-bf42-0f4284fc077e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:46.198224 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a24c6020-40be-4d43-bf42-0f4284fc077e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:46.240897 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a24c6020-40be-4d43-bf42-0f4284fc077e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:46.241667 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a24c6020-40be-4d43-bf42-0f4284fc077e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:46.242458 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.objects.instance [None req-a24c6020-40be-4d43-bf42-0f4284fc077e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lazy-loading 'fault' on Instance uuid 6af3cc97-b45c-4fde-9c9c-47a91dd69630 {{(pid=116085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:10:46.302465 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-a24c6020-40be-4d43-bf42-0f4284fc077e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:10:46.310846 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-a24c6020-40be-4d43-bf42-0f4284fc077e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:10:46.312381 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-a24c6020-40be-4d43-bf42-0f4284fc077e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00d8e37d934648708238997bded11462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae9bddc9870246e99f813976878279cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:10:46.313690 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-a24c6020-40be-4d43-bf42-0f4284fc077e tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 200 len: 1372 microversion: 2.20 time: 0.137980 Nov 16 16:10:46.314452 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 460/936] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:10:46 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 1372 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:10:47.334486 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-2b2143ba-8e60-4020-bd18-4dfcdd497c3b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:10:47.335407 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-2b2143ba-8e60-4020-bd18-4dfcdd497c3b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:10:47.342631 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2b2143ba-8e60-4020-bd18-4dfcdd497c3b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:47.343075 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2b2143ba-8e60-4020-bd18-4dfcdd497c3b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:47.343883 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2b2143ba-8e60-4020-bd18-4dfcdd497c3b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:47.344338 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2b2143ba-8e60-4020-bd18-4dfcdd497c3b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:47.358593 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-2b2143ba-8e60-4020-bd18-4dfcdd497c3b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] HTTP exception thrown: Instance 6af3cc97-b45c-4fde-9c9c-47a91dd69630 could not be found. Nov 16 16:10:47.359191 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-2b2143ba-8e60-4020-bd18-4dfcdd497c3b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Returning 404 to user: Instance 6af3cc97-b45c-4fde-9c9c-47a91dd69630 could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:10:47.360039 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-2b2143ba-8e60-4020-bd18-4dfcdd497c3b tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 404 len: 111 microversion: 2.20 time: 0.029842 Nov 16 16:10:47.360580 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 477/937] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 16:10:47 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 16 16:10:47.369138 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-f80ac641-d58d-4653-a042-9cdbfa18a1c2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '.version_select at 0x7f113c24a820>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:10:47.391374 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-f80ac641-d58d-4653-a042-9cdbfa18a1c2 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1711441512" status: 204 len: 0 microversion: 2.20 time: 0.026198 Nov 16 16:10:47.391993 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 461/938] 10.222.0.46 () {60 vars in 1261 bytes} [Tue Nov 16 16:10:47 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1711441512 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 16 16:10:49.153002 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0656c3f1-8d68-44f1-a935-f0411c1b8810 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:10:49.153505 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0656c3f1-8d68-44f1-a935-f0411c1b8810 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:10:49.160096 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0656c3f1-8d68-44f1-a935-f0411c1b8810 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:49.160577 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0656c3f1-8d68-44f1-a935-f0411c1b8810 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:49.161361 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0656c3f1-8d68-44f1-a935-f0411c1b8810 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:49.161799 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0656c3f1-8d68-44f1-a935-f0411c1b8810 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:49.175560 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-0656c3f1-8d68-44f1-a935-f0411c1b8810 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] HTTP exception thrown: Instance 6af3cc97-b45c-4fde-9c9c-47a91dd69630 could not be found. Nov 16 16:10:49.176186 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0656c3f1-8d68-44f1-a935-f0411c1b8810 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Returning 404 to user: Instance 6af3cc97-b45c-4fde-9c9c-47a91dd69630 could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:10:49.177021 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0656c3f1-8d68-44f1-a935-f0411c1b8810 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 404 len: 111 microversion: 2.1 time: 0.028728 Nov 16 16:10:49.177566 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 478/939] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 16 16:10:49 2021] DELETE /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:10:49.185806 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-560e1696-5d43-418e-b867-cf17e6d539aa tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:10:49.186416 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-560e1696-5d43-418e-b867-cf17e6d539aa tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6af3cc97-b45c-4fde-9c9c-47a91dd69630] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:10:49.192718 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-560e1696-5d43-418e-b867-cf17e6d539aa tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:49.193169 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-560e1696-5d43-418e-b867-cf17e6d539aa tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:49.193945 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-560e1696-5d43-418e-b867-cf17e6d539aa tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:49.194381 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-560e1696-5d43-418e-b867-cf17e6d539aa tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:49.209036 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.wsgi [None req-560e1696-5d43-418e-b867-cf17e6d539aa tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] HTTP exception thrown: Instance 6af3cc97-b45c-4fde-9c9c-47a91dd69630 could not be found. Nov 16 16:10:49.209617 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-560e1696-5d43-418e-b867-cf17e6d539aa tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Returning 404 to user: Instance 6af3cc97-b45c-4fde-9c9c-47a91dd69630 could not be found. {{(pid=116085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:10:49.210525 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-560e1696-5d43-418e-b867-cf17e6d539aa tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630" status: 404 len: 111 microversion: 2.1 time: 0.028676 Nov 16 16:10:49.211246 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 462/940] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:10:49 2021] GET /compute/v2.1/servers/6af3cc97-b45c-4fde-9c9c-47a91dd69630 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:10:50.369393 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1f08c373-f46b-40b3-9334-af269a7119e5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:10:50.369933 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1f08c373-f46b-40b3-9334-af269a7119e5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:10:50.376549 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1f08c373-f46b-40b3-9334-af269a7119e5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:50.377020 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1f08c373-f46b-40b3-9334-af269a7119e5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:50.377787 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1f08c373-f46b-40b3-9334-af269a7119e5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:50.378220 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1f08c373-f46b-40b3-9334-af269a7119e5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:50.392220 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-1f08c373-f46b-40b3-9334-af269a7119e5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] HTTP exception thrown: Instance 6447972e-6291-4e68-8271-c93523206230 could not be found. Nov 16 16:10:50.392949 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1f08c373-f46b-40b3-9334-af269a7119e5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Returning 404 to user: Instance 6447972e-6291-4e68-8271-c93523206230 could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:10:50.393783 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1f08c373-f46b-40b3-9334-af269a7119e5 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 404 len: 111 microversion: 2.1 time: 0.028550 Nov 16 16:10:50.394482 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 479/941] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 16 16:10:50 2021] DELETE /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:10:50.403812 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-d99d2a18-78f1-4286-8f6d-f30441949d63 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:10:50.404916 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-d99d2a18-78f1-4286-8f6d-f30441949d63 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] [instance: 6447972e-6291-4e68-8271-c93523206230] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:10:50.412195 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d99d2a18-78f1-4286-8f6d-f30441949d63 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:50.412842 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d99d2a18-78f1-4286-8f6d-f30441949d63 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:50.413859 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d99d2a18-78f1-4286-8f6d-f30441949d63 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:50.414515 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d99d2a18-78f1-4286-8f6d-f30441949d63 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:50.429813 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.wsgi [None req-d99d2a18-78f1-4286-8f6d-f30441949d63 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] HTTP exception thrown: Instance 6447972e-6291-4e68-8271-c93523206230 could not be found. Nov 16 16:10:50.431315 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-d99d2a18-78f1-4286-8f6d-f30441949d63 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] Returning 404 to user: Instance 6447972e-6291-4e68-8271-c93523206230 could not be found. {{(pid=116085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:10:50.433106 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-d99d2a18-78f1-4286-8f6d-f30441949d63 tempest-AttachVolumeShelveTestJSON-1649096866 tempest-AttachVolumeShelveTestJSON-1649096866-project] 10.222.0.46 "GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230" status: 404 len: 111 microversion: 2.1 time: 0.034587 Nov 16 16:10:50.433852 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 463/942] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:10:50 2021] GET /compute/v2.1/servers/6447972e-6291-4e68-8271-c93523206230 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:10:55.940174 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1d880656-6cfb-4a6f-91da-4f934206aa3a tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-692593904", "imageRef": "7c3bd8e0-8d7e-4cf7-90db-742c4f55e405", "flavorRef": "452", "networks": [{"uuid": "63a82f94-756b-4c4e-a3fc-7d796125074b"}]}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:10:55.994266 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.network.neutron [None req-1d880656-6cfb-4a6f-91da-4f934206aa3a tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] validate_networks() for [('63a82f94-756b-4c4e-a3fc-7d796125074b', None, None, None, None, None)] {{(pid=116084) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 16:10:56.361957 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-1d880656-6cfb-4a6f-91da-4f934206aa3a tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Flavor limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 16:10:56.362381 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-1d880656-6cfb-4a6f-91da-4f934206aa3a tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Image limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 16:10:56.362856 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-1d880656-6cfb-4a6f-91da-4f934206aa3a tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Flavor pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 16:10:56.363264 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-1d880656-6cfb-4a6f-91da-4f934206aa3a tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Image pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 16:10:56.363709 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-1d880656-6cfb-4a6f-91da-4f934206aa3a tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 16:10:56.373332 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1d880656-6cfb-4a6f-91da-4f934206aa3a tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:56.373779 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1d880656-6cfb-4a6f-91da-4f934206aa3a tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:56.374586 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1d880656-6cfb-4a6f-91da-4f934206aa3a tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:56.375023 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1d880656-6cfb-4a6f-91da-4f934206aa3a tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:56.388995 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-5e1382a1-2336-4096-8bbf-11bd5774e3cf tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-321947449", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1166381435", "security_groups": [{"name": "tempest-secgroup-smoke-1125201303"}], "block_device_mapping_v2": [{"uuid": "e6d0f1d1-deb5-48c0-a34b-99a4045495e5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d76e01f2-cefd-4113-8b4c-ae0a7cc24037"}]}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:10:56.391709 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-1d880656-6cfb-4a6f-91da-4f934206aa3a tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Getting quotas for project 261a56c38b564260b994aa1efc3fc829. Resources: {'instances', 'ram', 'cores'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:10:56.395500 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-1d880656-6cfb-4a6f-91da-4f934206aa3a tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Getting quotas for user 1ff420f6aa9044889cdc43c6e2926d12 and project 261a56c38b564260b994aa1efc3fc829. Resources: {'instances', 'ram', 'cores'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:10:56.408101 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1d880656-6cfb-4a6f-91da-4f934206aa3a tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Going to run 1 instances... {{(pid=116084) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 16:10:56.410426 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1d880656-6cfb-4a6f-91da-4f934206aa3a tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 77b84f3a-873d-4d5b-88c1-655bc337610e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c3bd8e0-8d7e-4cf7-90db-742c4f55e405',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116084) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 16:10:56.457719 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1d880656-6cfb-4a6f-91da-4f934206aa3a tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.636642 Nov 16 16:10:56.458351 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 480/943] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 16 16:10:55 2021] POST /compute/v2.1/servers => generated 380 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 16:10:56.468592 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-841d6758-5e14-4d82-84eb-84e79a7a97b1 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:10:56.469649 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-841d6758-5e14-4d82-84eb-84e79a7a97b1 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 77b84f3a-873d-4d5b-88c1-655bc337610e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:10:56.534759 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.network.neutron [None req-5e1382a1-2336-4096-8bbf-11bd5774e3cf tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] validate_networks() for [('d76e01f2-cefd-4113-8b4c-ae0a7cc24037', None, None, None, None, None)] {{(pid=116085) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 16:10:56.558109 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-841d6758-5e14-4d82-84eb-84e79a7a97b1 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff420f6aa9044889cdc43c6e2926d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a56c38b564260b994aa1efc3fc829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:10:56.566423 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-841d6758-5e14-4d82-84eb-84e79a7a97b1 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/77b84f3a-873d-4d5b-88c1-655bc337610e" status: 200 len: 1217 microversion: 2.1 time: 0.101381 Nov 16 16:10:56.567015 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 481/944] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:10:56 2021] GET /compute/v2.1/servers/77b84f3a-873d-4d5b-88c1-655bc337610e => generated 1217 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:10:57.041620 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-5e1382a1-2336-4096-8bbf-11bd5774e3cf tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Flavor limits 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 16:10:57.042043 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-5e1382a1-2336-4096-8bbf-11bd5774e3cf tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Image limits 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 16:10:57.042510 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-5e1382a1-2336-4096-8bbf-11bd5774e3cf tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Flavor pref 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 16:10:57.042916 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-5e1382a1-2336-4096-8bbf-11bd5774e3cf tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Image pref 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 16:10:57.043504 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-5e1382a1-2336-4096-8bbf-11bd5774e3cf tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 16:10:57.051938 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5e1382a1-2336-4096-8bbf-11bd5774e3cf tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:57.052379 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5e1382a1-2336-4096-8bbf-11bd5774e3cf tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:57.053193 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5e1382a1-2336-4096-8bbf-11bd5774e3cf tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:57.053642 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5e1382a1-2336-4096-8bbf-11bd5774e3cf tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:57.072652 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-5e1382a1-2336-4096-8bbf-11bd5774e3cf tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Getting quotas for project d2bdf7025cb744f088b95cb0bba5169b. Resources: {'instances', 'ram', 'cores'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:10:57.076771 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-5e1382a1-2336-4096-8bbf-11bd5774e3cf tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Getting quotas for user d363b1ed870843a6ba751e0d1ea0bd1e and project d2bdf7025cb744f088b95cb0bba5169b. Resources: {'instances', 'ram', 'cores'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:10:57.142470 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-5e1382a1-2336-4096-8bbf-11bd5774e3cf tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Going to run 1 instances... {{(pid=116085) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 16:10:57.144691 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-5e1382a1-2336-4096-8bbf-11bd5774e3cf tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: 6dcc72f3-865c-48e2-9ae9-7d91eef84f35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e6d0f1d1-deb5-48c0-a34b-99a4045495e5',volume_size=None,volume_type=None)] {{(pid=116085) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 16:10:57.279393 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-5e1382a1-2336-4096-8bbf-11bd5774e3cf tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.894041 Nov 16 16:10:57.280251 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 464/945] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 16 16:10:56 2021] POST /compute/v2.1/servers => generated 406 bytes in 895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 16 16:10:57.290540 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-dbc169ea-5a93-44e8-8c8d-6f678d4bacce tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:10:57.293278 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-dbc169ea-5a93-44e8-8c8d-6f678d4bacce tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: 6dcc72f3-865c-48e2-9ae9-7d91eef84f35] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:10:57.346943 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-dbc169ea-5a93-44e8-8c8d-6f678d4bacce tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:10:57.356200 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-dbc169ea-5a93-44e8-8c8d-6f678d4bacce tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/6dcc72f3-865c-48e2-9ae9-7d91eef84f35" status: 200 len: 1094 microversion: 2.1 time: 0.070024 Nov 16 16:10:57.356766 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 482/946] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:10:57 2021] GET /compute/v2.1/servers/6dcc72f3-865c-48e2-9ae9-7d91eef84f35 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:10:57.586112 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-d1ee0c50-97d0-4af8-8795-36923db08af5 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:10:57.590006 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-d1ee0c50-97d0-4af8-8795-36923db08af5 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 77b84f3a-873d-4d5b-88c1-655bc337610e] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:10:57.597365 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d1ee0c50-97d0-4af8-8795-36923db08af5 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:57.598104 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d1ee0c50-97d0-4af8-8795-36923db08af5 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:57.599100 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d1ee0c50-97d0-4af8-8795-36923db08af5 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:57.599796 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d1ee0c50-97d0-4af8-8795-36923db08af5 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:57.674684 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-d1ee0c50-97d0-4af8-8795-36923db08af5 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff420f6aa9044889cdc43c6e2926d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a56c38b564260b994aa1efc3fc829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:10:57.683121 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-d1ee0c50-97d0-4af8-8795-36923db08af5 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/77b84f3a-873d-4d5b-88c1-655bc337610e" status: 200 len: 1275 microversion: 2.1 time: 0.101317 Nov 16 16:10:57.684086 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 465/947] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:10:57 2021] GET /compute/v2.1/servers/77b84f3a-873d-4d5b-88c1-655bc337610e => generated 1275 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:10:58.373401 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3eed69ad-e9fa-449d-985e-dab210ee0275 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:10:58.374006 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-3eed69ad-e9fa-449d-985e-dab210ee0275 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: 6dcc72f3-865c-48e2-9ae9-7d91eef84f35] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:10:58.380534 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3eed69ad-e9fa-449d-985e-dab210ee0275 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:58.380980 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3eed69ad-e9fa-449d-985e-dab210ee0275 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:58.381762 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3eed69ad-e9fa-449d-985e-dab210ee0275 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:58.382232 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3eed69ad-e9fa-449d-985e-dab210ee0275 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:58.477629 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-3eed69ad-e9fa-449d-985e-dab210ee0275 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:10:58.486334 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-3eed69ad-e9fa-449d-985e-dab210ee0275 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/6dcc72f3-865c-48e2-9ae9-7d91eef84f35" status: 200 len: 1210 microversion: 2.1 time: 0.116433 Nov 16 16:10:58.487677 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 483/948] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:10:58 2021] GET /compute/v2.1/servers/6dcc72f3-865c-48e2-9ae9-7d91eef84f35 => generated 1210 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:10:58.702992 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-3d0a5a5a-ada0-4304-bddf-9f1761d4dab1 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:10:58.703920 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-3d0a5a5a-ada0-4304-bddf-9f1761d4dab1 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 77b84f3a-873d-4d5b-88c1-655bc337610e] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:10:58.710918 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3d0a5a5a-ada0-4304-bddf-9f1761d4dab1 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:58.712813 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3d0a5a5a-ada0-4304-bddf-9f1761d4dab1 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:58.713612 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3d0a5a5a-ada0-4304-bddf-9f1761d4dab1 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:58.714270 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3d0a5a5a-ada0-4304-bddf-9f1761d4dab1 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:58.984969 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-3d0a5a5a-ada0-4304-bddf-9f1761d4dab1 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff420f6aa9044889cdc43c6e2926d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a56c38b564260b994aa1efc3fc829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:10:58.998302 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-3d0a5a5a-ada0-4304-bddf-9f1761d4dab1 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/77b84f3a-873d-4d5b-88c1-655bc337610e" status: 200 len: 1317 microversion: 2.1 time: 0.299091 Nov 16 16:10:58.999059 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 466/949] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:10:58 2021] GET /compute/v2.1/servers/77b84f3a-873d-4d5b-88c1-655bc337610e => generated 1317 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:10:59.217977 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-4a1b3083-cd80-43bf-ad9c-07f8c6aca786 req-bcebc7b6-7315-460b-8562-5a36f3e89037 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77b84f3a-873d-4d5b-88c1-655bc337610e", "tag": "35db0ace-0705-4914-a3c5-dc0165afe4c6"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:10:59.219939 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:10:59.219939 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Nov 16 16:10:59.230310 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-4a1b3083-cd80-43bf-ad9c-07f8c6aca786 req-bcebc7b6-7315-460b-8562-5a36f3e89037 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:59.230856 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-4a1b3083-cd80-43bf-ad9c-07f8c6aca786 req-bcebc7b6-7315-460b-8562-5a36f3e89037 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:59.256152 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-4a1b3083-cd80-43bf-ad9c-07f8c6aca786 req-bcebc7b6-7315-460b-8562-5a36f3e89037 service nova] Creating event network-changed:35db0ace-0705-4914-a3c5-dc0165afe4c6 for instance 77b84f3a-873d-4d5b-88c1-655bc337610e on hv-cinder-81809 Nov 16 16:10:59.272700 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-4a1b3083-cd80-43bf-ad9c-07f8c6aca786 req-bcebc7b6-7315-460b-8562-5a36f3e89037 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058129 Nov 16 16:10:59.273335 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 484/950] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:10:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:10:59.505379 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-f3cc56b8-2b44-4a7b-8ceb-b4817be7debb tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:10:59.506067 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-f3cc56b8-2b44-4a7b-8ceb-b4817be7debb tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: 6dcc72f3-865c-48e2-9ae9-7d91eef84f35] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:10:59.513106 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f3cc56b8-2b44-4a7b-8ceb-b4817be7debb tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:59.513634 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f3cc56b8-2b44-4a7b-8ceb-b4817be7debb tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:59.514667 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f3cc56b8-2b44-4a7b-8ceb-b4817be7debb tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:10:59.515347 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f3cc56b8-2b44-4a7b-8ceb-b4817be7debb tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:10:59.738548 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-f3cc56b8-2b44-4a7b-8ceb-b4817be7debb tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:10:59.757058 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-f3cc56b8-2b44-4a7b-8ceb-b4817be7debb tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/6dcc72f3-865c-48e2-9ae9-7d91eef84f35" status: 200 len: 1266 microversion: 2.1 time: 0.256351 Nov 16 16:10:59.757937 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 467/951] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:10:59 2021] GET /compute/v2.1/servers/6dcc72f3-865c-48e2-9ae9-7d91eef84f35 => generated 1266 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:11:00.017420 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ec8021a0-6532-47c2-99c7-90d890ec9fa8 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:11:00.018298 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ec8021a0-6532-47c2-99c7-90d890ec9fa8 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 77b84f3a-873d-4d5b-88c1-655bc337610e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:00.032009 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ec8021a0-6532-47c2-99c7-90d890ec9fa8 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:00.033397 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ec8021a0-6532-47c2-99c7-90d890ec9fa8 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:00.034893 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ec8021a0-6532-47c2-99c7-90d890ec9fa8 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:00.035787 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ec8021a0-6532-47c2-99c7-90d890ec9fa8 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:00.050135 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-05a9d5f5-1dd7-426f-94f0-bf541a3e9111 req-267f7d0b-34d1-4bbf-9a1d-9f3513dfe7c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dcc72f3-865c-48e2-9ae9-7d91eef84f35", "tag": "10f5fb1e-fddd-4de2-b420-4ed412992643"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:11:00.051869 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:11:00.051869 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Nov 16 16:11:00.069976 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-05a9d5f5-1dd7-426f-94f0-bf541a3e9111 req-267f7d0b-34d1-4bbf-9a1d-9f3513dfe7c8 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:00.070428 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-05a9d5f5-1dd7-426f-94f0-bf541a3e9111 req-267f7d0b-34d1-4bbf-9a1d-9f3513dfe7c8 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:00.089313 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-05a9d5f5-1dd7-426f-94f0-bf541a3e9111 req-267f7d0b-34d1-4bbf-9a1d-9f3513dfe7c8 service nova] Creating event network-changed:10f5fb1e-fddd-4de2-b420-4ed412992643 for instance 6dcc72f3-865c-48e2-9ae9-7d91eef84f35 on hv-cinder-81809 Nov 16 16:11:00.094728 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-05a9d5f5-1dd7-426f-94f0-bf541a3e9111 req-267f7d0b-34d1-4bbf-9a1d-9f3513dfe7c8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048990 Nov 16 16:11:00.096301 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 468/952] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:11:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:11:00.314503 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ec8021a0-6532-47c2-99c7-90d890ec9fa8 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff420f6aa9044889cdc43c6e2926d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a56c38b564260b994aa1efc3fc829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:11:00.323837 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ec8021a0-6532-47c2-99c7-90d890ec9fa8 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/77b84f3a-873d-4d5b-88c1-655bc337610e" status: 200 len: 1317 microversion: 2.1 time: 0.310353 Nov 16 16:11:00.324394 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 485/953] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:11:00 2021] GET /compute/v2.1/servers/77b84f3a-873d-4d5b-88c1-655bc337610e => generated 1317 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:11:00.776974 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-767d60cf-9f4f-46b7-b4b5-c77e897db68f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:11:00.777776 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-767d60cf-9f4f-46b7-b4b5-c77e897db68f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: 6dcc72f3-865c-48e2-9ae9-7d91eef84f35] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:00.785318 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-767d60cf-9f4f-46b7-b4b5-c77e897db68f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:00.785763 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-767d60cf-9f4f-46b7-b4b5-c77e897db68f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:00.786540 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-767d60cf-9f4f-46b7-b4b5-c77e897db68f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:00.787317 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-767d60cf-9f4f-46b7-b4b5-c77e897db68f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:00.967839 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-767d60cf-9f4f-46b7-b4b5-c77e897db68f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:11:00.975550 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-767d60cf-9f4f-46b7-b4b5-c77e897db68f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/6dcc72f3-865c-48e2-9ae9-7d91eef84f35" status: 200 len: 1266 microversion: 2.1 time: 0.203675 Nov 16 16:11:00.976333 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 469/954] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:11:00 2021] GET /compute/v2.1/servers/6dcc72f3-865c-48e2-9ae9-7d91eef84f35 => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:11:01.341111 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f2d1dd48-9e21-4ac6-b763-05c29595b26d tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:11:01.341710 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f2d1dd48-9e21-4ac6-b763-05c29595b26d tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 77b84f3a-873d-4d5b-88c1-655bc337610e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:01.347747 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f2d1dd48-9e21-4ac6-b763-05c29595b26d tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:01.348195 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f2d1dd48-9e21-4ac6-b763-05c29595b26d tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:01.348970 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f2d1dd48-9e21-4ac6-b763-05c29595b26d tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:01.349733 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f2d1dd48-9e21-4ac6-b763-05c29595b26d tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:01.490693 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f2d1dd48-9e21-4ac6-b763-05c29595b26d tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff420f6aa9044889cdc43c6e2926d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a56c38b564260b994aa1efc3fc829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:11:01.498667 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f2d1dd48-9e21-4ac6-b763-05c29595b26d tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/77b84f3a-873d-4d5b-88c1-655bc337610e" status: 200 len: 1317 microversion: 2.1 time: 0.161219 Nov 16 16:11:01.499240 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 486/955] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:11:01 2021] GET /compute/v2.1/servers/77b84f3a-873d-4d5b-88c1-655bc337610e => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:11:01.992188 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-4c22e179-f378-4400-8ab9-9e0332f4c7c8 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:11:01.993357 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-4c22e179-f378-4400-8ab9-9e0332f4c7c8 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: 6dcc72f3-865c-48e2-9ae9-7d91eef84f35] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:01.999850 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4c22e179-f378-4400-8ab9-9e0332f4c7c8 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:02.000457 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4c22e179-f378-4400-8ab9-9e0332f4c7c8 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:02.001361 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4c22e179-f378-4400-8ab9-9e0332f4c7c8 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:02.002004 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4c22e179-f378-4400-8ab9-9e0332f4c7c8 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:02.137996 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-4c22e179-f378-4400-8ab9-9e0332f4c7c8 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:11:02.145200 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-4c22e179-f378-4400-8ab9-9e0332f4c7c8 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/6dcc72f3-865c-48e2-9ae9-7d91eef84f35" status: 200 len: 1266 microversion: 2.1 time: 0.156748 Nov 16 16:11:02.145761 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 470/956] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:11:01 2021] GET /compute/v2.1/servers/6dcc72f3-865c-48e2-9ae9-7d91eef84f35 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:11:02.515396 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f45b3471-e50a-4bc9-863c-0c10fa6cafe9 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:11:02.516040 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f45b3471-e50a-4bc9-863c-0c10fa6cafe9 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 77b84f3a-873d-4d5b-88c1-655bc337610e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:02.522173 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f45b3471-e50a-4bc9-863c-0c10fa6cafe9 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:02.522611 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f45b3471-e50a-4bc9-863c-0c10fa6cafe9 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:02.523377 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f45b3471-e50a-4bc9-863c-0c10fa6cafe9 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:02.524501 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f45b3471-e50a-4bc9-863c-0c10fa6cafe9 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:02.667654 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f45b3471-e50a-4bc9-863c-0c10fa6cafe9 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff420f6aa9044889cdc43c6e2926d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a56c38b564260b994aa1efc3fc829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:11:02.674933 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f45b3471-e50a-4bc9-863c-0c10fa6cafe9 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/77b84f3a-873d-4d5b-88c1-655bc337610e" status: 200 len: 1317 microversion: 2.1 time: 0.163226 Nov 16 16:11:02.675978 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 487/957] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:11:02 2021] GET /compute/v2.1/servers/77b84f3a-873d-4d5b-88c1-655bc337610e => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:11:03.162406 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-6bea3816-a8ec-4791-863d-e55874200179 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:11:03.163010 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-6bea3816-a8ec-4791-863d-e55874200179 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: 6dcc72f3-865c-48e2-9ae9-7d91eef84f35] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:03.169399 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6bea3816-a8ec-4791-863d-e55874200179 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:03.169773 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6bea3816-a8ec-4791-863d-e55874200179 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:03.170546 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6bea3816-a8ec-4791-863d-e55874200179 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:03.170976 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6bea3816-a8ec-4791-863d-e55874200179 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:03.303824 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-6bea3816-a8ec-4791-863d-e55874200179 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:11:03.311875 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-6bea3816-a8ec-4791-863d-e55874200179 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/6dcc72f3-865c-48e2-9ae9-7d91eef84f35" status: 200 len: 1266 microversion: 2.1 time: 0.153036 Nov 16 16:11:03.312449 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 471/958] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:11:03 2021] GET /compute/v2.1/servers/6dcc72f3-865c-48e2-9ae9-7d91eef84f35 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:11:03.692817 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-611f3293-521b-413e-a065-c8b572a4f741 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:11:03.693429 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-611f3293-521b-413e-a065-c8b572a4f741 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 77b84f3a-873d-4d5b-88c1-655bc337610e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:03.700451 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-611f3293-521b-413e-a065-c8b572a4f741 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:03.700898 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-611f3293-521b-413e-a065-c8b572a4f741 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:03.701673 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-611f3293-521b-413e-a065-c8b572a4f741 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:03.702107 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-611f3293-521b-413e-a065-c8b572a4f741 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:03.834357 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-611f3293-521b-413e-a065-c8b572a4f741 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff420f6aa9044889cdc43c6e2926d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a56c38b564260b994aa1efc3fc829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:11:03.842300 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-611f3293-521b-413e-a065-c8b572a4f741 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/77b84f3a-873d-4d5b-88c1-655bc337610e" status: 200 len: 1317 microversion: 2.1 time: 0.153180 Nov 16 16:11:03.842872 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 488/959] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:11:03 2021] GET /compute/v2.1/servers/77b84f3a-873d-4d5b-88c1-655bc337610e => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:11:04.329155 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-de8ccff7-cd12-415e-bcc8-dcab68dade9d tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:11:04.329768 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-de8ccff7-cd12-415e-bcc8-dcab68dade9d tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: 6dcc72f3-865c-48e2-9ae9-7d91eef84f35] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:04.335929 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-de8ccff7-cd12-415e-bcc8-dcab68dade9d tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:04.336496 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-de8ccff7-cd12-415e-bcc8-dcab68dade9d tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:04.337282 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-de8ccff7-cd12-415e-bcc8-dcab68dade9d tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:04.337716 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-de8ccff7-cd12-415e-bcc8-dcab68dade9d tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:04.473980 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-de8ccff7-cd12-415e-bcc8-dcab68dade9d tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:11:04.481932 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-de8ccff7-cd12-415e-bcc8-dcab68dade9d tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/6dcc72f3-865c-48e2-9ae9-7d91eef84f35" status: 200 len: 1266 microversion: 2.1 time: 0.156478 Nov 16 16:11:04.482501 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 472/960] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:11:04 2021] GET /compute/v2.1/servers/6dcc72f3-865c-48e2-9ae9-7d91eef84f35 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:11:04.683537 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-c7aeb5da-522e-4a5a-a477-5251b09391b9 req-42098247-186c-4bcb-ae83-efeef8080dc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77b84f3a-873d-4d5b-88c1-655bc337610e", "name": "network-vif-plugged", "status": "completed", "tag": "35db0ace-0705-4914-a3c5-dc0165afe4c6"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:11:04.685157 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:11:04.685157 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Nov 16 16:11:04.692250 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-c7aeb5da-522e-4a5a-a477-5251b09391b9 req-42098247-186c-4bcb-ae83-efeef8080dc4 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:04.692947 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-c7aeb5da-522e-4a5a-a477-5251b09391b9 req-42098247-186c-4bcb-ae83-efeef8080dc4 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:04.715379 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-c7aeb5da-522e-4a5a-a477-5251b09391b9 req-42098247-186c-4bcb-ae83-efeef8080dc4 service nova] Creating event network-vif-plugged:35db0ace-0705-4914-a3c5-dc0165afe4c6 for instance 77b84f3a-873d-4d5b-88c1-655bc337610e on hv-cinder-81809 Nov 16 16:11:04.720148 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-c7aeb5da-522e-4a5a-a477-5251b09391b9 req-42098247-186c-4bcb-ae83-efeef8080dc4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040417 Nov 16 16:11:04.720746 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 489/961] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:11:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:11:04.858918 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-f7dbf37c-239c-47f4-a2e5-d8f54d3a5f7d tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:11:04.859597 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-f7dbf37c-239c-47f4-a2e5-d8f54d3a5f7d tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 77b84f3a-873d-4d5b-88c1-655bc337610e] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:04.865456 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f7dbf37c-239c-47f4-a2e5-d8f54d3a5f7d tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:04.865904 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f7dbf37c-239c-47f4-a2e5-d8f54d3a5f7d tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:04.866678 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f7dbf37c-239c-47f4-a2e5-d8f54d3a5f7d tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:04.867113 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f7dbf37c-239c-47f4-a2e5-d8f54d3a5f7d tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:05.262701 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-f7dbf37c-239c-47f4-a2e5-d8f54d3a5f7d tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff420f6aa9044889cdc43c6e2926d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a56c38b564260b994aa1efc3fc829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:11:05.270097 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-f7dbf37c-239c-47f4-a2e5-d8f54d3a5f7d tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/77b84f3a-873d-4d5b-88c1-655bc337610e" status: 200 len: 1317 microversion: 2.1 time: 0.414881 Nov 16 16:11:05.270859 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 473/962] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:11:04 2021] GET /compute/v2.1/servers/77b84f3a-873d-4d5b-88c1-655bc337610e => generated 1317 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:11:05.500740 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-de59a5dd-554c-4b02-840f-7b35fe25a6b3 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:11:05.501447 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-de59a5dd-554c-4b02-840f-7b35fe25a6b3 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: 6dcc72f3-865c-48e2-9ae9-7d91eef84f35] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:05.507412 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-de59a5dd-554c-4b02-840f-7b35fe25a6b3 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:05.508742 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-de59a5dd-554c-4b02-840f-7b35fe25a6b3 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:05.509438 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-de59a5dd-554c-4b02-840f-7b35fe25a6b3 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:05.509940 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-de59a5dd-554c-4b02-840f-7b35fe25a6b3 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:05.728401 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-de59a5dd-554c-4b02-840f-7b35fe25a6b3 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:11:05.737125 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-de59a5dd-554c-4b02-840f-7b35fe25a6b3 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/6dcc72f3-865c-48e2-9ae9-7d91eef84f35" status: 200 len: 1266 microversion: 2.1 time: 0.240513 Nov 16 16:11:05.737684 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 490/963] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:11:05 2021] GET /compute/v2.1/servers/6dcc72f3-865c-48e2-9ae9-7d91eef84f35 => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:11:06.287551 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-571ebac6-72d3-4ee4-a175-550cde581b05 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:11:06.288163 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-571ebac6-72d3-4ee4-a175-550cde581b05 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 77b84f3a-873d-4d5b-88c1-655bc337610e] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:06.295037 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-571ebac6-72d3-4ee4-a175-550cde581b05 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:06.295491 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-571ebac6-72d3-4ee4-a175-550cde581b05 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:06.296270 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-571ebac6-72d3-4ee4-a175-550cde581b05 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:06.296699 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-571ebac6-72d3-4ee4-a175-550cde581b05 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:06.429085 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-571ebac6-72d3-4ee4-a175-550cde581b05 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff420f6aa9044889cdc43c6e2926d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a56c38b564260b994aa1efc3fc829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:11:06.437323 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-571ebac6-72d3-4ee4-a175-550cde581b05 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/77b84f3a-873d-4d5b-88c1-655bc337610e" status: 200 len: 1508 microversion: 2.1 time: 0.153339 Nov 16 16:11:06.437902 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 474/964] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:11:06 2021] GET /compute/v2.1/servers/77b84f3a-873d-4d5b-88c1-655bc337610e => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:11:06.754514 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-9ff0f43e-b0e8-40f0-b83e-2e7a48f8f77f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:11:06.756288 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-9ff0f43e-b0e8-40f0-b83e-2e7a48f8f77f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: 6dcc72f3-865c-48e2-9ae9-7d91eef84f35] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:06.763705 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9ff0f43e-b0e8-40f0-b83e-2e7a48f8f77f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:06.764153 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9ff0f43e-b0e8-40f0-b83e-2e7a48f8f77f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:06.764945 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9ff0f43e-b0e8-40f0-b83e-2e7a48f8f77f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:06.765373 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9ff0f43e-b0e8-40f0-b83e-2e7a48f8f77f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:06.898014 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-9ff0f43e-b0e8-40f0-b83e-2e7a48f8f77f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:11:06.906281 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-9ff0f43e-b0e8-40f0-b83e-2e7a48f8f77f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/6dcc72f3-865c-48e2-9ae9-7d91eef84f35" status: 200 len: 1266 microversion: 2.1 time: 0.155830 Nov 16 16:11:06.906841 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 491/965] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:11:06 2021] GET /compute/v2.1/servers/6dcc72f3-865c-48e2-9ae9-7d91eef84f35 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:11:07.787727 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-1b75008a-fa73-414d-ad41-24633ae6f62f tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c556fef4-8685-471b-ac4b-c58480c3d7ca"}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:11:07.788776 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-1b75008a-fa73-414d-ad41-24633ae6f62f tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 77b84f3a-873d-4d5b-88c1-655bc337610e] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:07.795485 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1b75008a-fa73-414d-ad41-24633ae6f62f tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:07.796020 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1b75008a-fa73-414d-ad41-24633ae6f62f tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:07.796778 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1b75008a-fa73-414d-ad41-24633ae6f62f tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:07.797202 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1b75008a-fa73-414d-ad41-24633ae6f62f tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:07.923929 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-8075fabe-b4f0-4b1a-ab56-fa038678eb0f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:11:07.924540 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-8075fabe-b4f0-4b1a-ab56-fa038678eb0f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: 6dcc72f3-865c-48e2-9ae9-7d91eef84f35] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:07.931311 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8075fabe-b4f0-4b1a-ab56-fa038678eb0f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:07.931863 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8075fabe-b4f0-4b1a-ab56-fa038678eb0f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:07.932633 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8075fabe-b4f0-4b1a-ab56-fa038678eb0f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:07.933067 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8075fabe-b4f0-4b1a-ab56-fa038678eb0f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:08.058582 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-1b75008a-fa73-414d-ad41-24633ae6f62f tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "POST /compute/v2.1/servers/77b84f3a-873d-4d5b-88c1-655bc337610e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274115 Nov 16 16:11:08.059244 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 475/966] 10.222.0.46 () {60 vars in 1322 bytes} [Tue Nov 16 16:11:07 2021] POST /compute/v2.1/servers/77b84f3a-873d-4d5b-88c1-655bc337610e/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:11:08.084044 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-8075fabe-b4f0-4b1a-ab56-fa038678eb0f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:11:08.092817 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-8075fabe-b4f0-4b1a-ab56-fa038678eb0f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/6dcc72f3-865c-48e2-9ae9-7d91eef84f35" status: 200 len: 1266 microversion: 2.1 time: 0.172604 Nov 16 16:11:08.093389 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 492/967] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:11:07 2021] GET /compute/v2.1/servers/6dcc72f3-865c-48e2-9ae9-7d91eef84f35 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:11:09.110471 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-b3df05ce-19df-4708-9c2a-dba01f080e61 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:11:09.111167 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-b3df05ce-19df-4708-9c2a-dba01f080e61 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: 6dcc72f3-865c-48e2-9ae9-7d91eef84f35] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:09.118149 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b3df05ce-19df-4708-9c2a-dba01f080e61 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:09.118588 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b3df05ce-19df-4708-9c2a-dba01f080e61 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:09.119369 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b3df05ce-19df-4708-9c2a-dba01f080e61 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:09.119825 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b3df05ce-19df-4708-9c2a-dba01f080e61 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:09.254384 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-b3df05ce-19df-4708-9c2a-dba01f080e61 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:11:09.262413 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-b3df05ce-19df-4708-9c2a-dba01f080e61 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/6dcc72f3-865c-48e2-9ae9-7d91eef84f35" status: 200 len: 1266 microversion: 2.1 time: 0.155955 Nov 16 16:11:09.262982 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 476/968] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:11:09 2021] GET /compute/v2.1/servers/6dcc72f3-865c-48e2-9ae9-7d91eef84f35 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:11:10.279411 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-67817184-2ba6-4b92-8a8a-abc584773b29 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:11:10.280043 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-67817184-2ba6-4b92-8a8a-abc584773b29 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: 6dcc72f3-865c-48e2-9ae9-7d91eef84f35] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:10.286307 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-67817184-2ba6-4b92-8a8a-abc584773b29 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:10.286756 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-67817184-2ba6-4b92-8a8a-abc584773b29 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:10.287567 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-67817184-2ba6-4b92-8a8a-abc584773b29 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:10.288005 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-67817184-2ba6-4b92-8a8a-abc584773b29 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:10.423957 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-67817184-2ba6-4b92-8a8a-abc584773b29 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:11:10.431830 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-67817184-2ba6-4b92-8a8a-abc584773b29 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/6dcc72f3-865c-48e2-9ae9-7d91eef84f35" status: 200 len: 1266 microversion: 2.1 time: 0.156228 Nov 16 16:11:10.432396 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 493/969] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:11:10 2021] GET /compute/v2.1/servers/6dcc72f3-865c-48e2-9ae9-7d91eef84f35 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:11:10.739477 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-26b4b7a8-eab5-4ed1-92da-17efca5c7e70 req-ae1a67ad-8817-4319-8cc2-b49297bd46aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dcc72f3-865c-48e2-9ae9-7d91eef84f35", "name": "network-vif-plugged", "status": "completed", "tag": "10f5fb1e-fddd-4de2-b420-4ed412992643"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:11:10.741072 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:11:10.741072 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Nov 16 16:11:10.748726 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-26b4b7a8-eab5-4ed1-92da-17efca5c7e70 req-ae1a67ad-8817-4319-8cc2-b49297bd46aa service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:10.749248 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-26b4b7a8-eab5-4ed1-92da-17efca5c7e70 req-ae1a67ad-8817-4319-8cc2-b49297bd46aa service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:10.762089 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-26b4b7a8-eab5-4ed1-92da-17efca5c7e70 req-ae1a67ad-8817-4319-8cc2-b49297bd46aa service nova] Creating event network-vif-plugged:10f5fb1e-fddd-4de2-b420-4ed412992643 for instance 6dcc72f3-865c-48e2-9ae9-7d91eef84f35 on hv-cinder-81809 Nov 16 16:11:10.767013 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-26b4b7a8-eab5-4ed1-92da-17efca5c7e70 req-ae1a67ad-8817-4319-8cc2-b49297bd46aa service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031446 Nov 16 16:11:10.768020 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 477/970] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:11:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:11:11.448930 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-2fd733c0-0e9a-4ce3-ba33-3a2af5eb86ce tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:11:11.449539 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-2fd733c0-0e9a-4ce3-ba33-3a2af5eb86ce tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: 6dcc72f3-865c-48e2-9ae9-7d91eef84f35] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:11.455800 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2fd733c0-0e9a-4ce3-ba33-3a2af5eb86ce tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:11.456255 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2fd733c0-0e9a-4ce3-ba33-3a2af5eb86ce tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:11.457034 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2fd733c0-0e9a-4ce3-ba33-3a2af5eb86ce tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:11.457472 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2fd733c0-0e9a-4ce3-ba33-3a2af5eb86ce tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:11.589229 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-2fd733c0-0e9a-4ce3-ba33-3a2af5eb86ce tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:11:11.596516 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-2fd733c0-0e9a-4ce3-ba33-3a2af5eb86ce tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/6dcc72f3-865c-48e2-9ae9-7d91eef84f35" status: 200 len: 1266 microversion: 2.1 time: 0.151829 Nov 16 16:11:11.597090 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 494/971] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:11:11 2021] GET /compute/v2.1/servers/6dcc72f3-865c-48e2-9ae9-7d91eef84f35 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:11:12.614286 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-2bec5710-3bc1-4ff1-8908-0dac159470d9 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:11:12.614899 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-2bec5710-3bc1-4ff1-8908-0dac159470d9 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: 6dcc72f3-865c-48e2-9ae9-7d91eef84f35] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:12.623544 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2bec5710-3bc1-4ff1-8908-0dac159470d9 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:12.623998 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2bec5710-3bc1-4ff1-8908-0dac159470d9 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:12.624773 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2bec5710-3bc1-4ff1-8908-0dac159470d9 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:12.625209 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2bec5710-3bc1-4ff1-8908-0dac159470d9 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:12.770145 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-2bec5710-3bc1-4ff1-8908-0dac159470d9 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:11:12.778630 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-2bec5710-3bc1-4ff1-8908-0dac159470d9 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/6dcc72f3-865c-48e2-9ae9-7d91eef84f35" status: 200 len: 1452 microversion: 2.1 time: 0.168392 Nov 16 16:11:12.779211 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 478/972] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:11:12 2021] GET /compute/v2.1/servers/6dcc72f3-865c-48e2-9ae9-7d91eef84f35 => generated 1452 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:11:12.795267 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-dcd16c50-0624-4b1f-a99f-2c23d8149562 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:11:12.795986 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-dcd16c50-0624-4b1f-a99f-2c23d8149562 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: 6dcc72f3-865c-48e2-9ae9-7d91eef84f35] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:12.802205 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dcd16c50-0624-4b1f-a99f-2c23d8149562 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:12.802644 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dcd16c50-0624-4b1f-a99f-2c23d8149562 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:12.803488 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dcd16c50-0624-4b1f-a99f-2c23d8149562 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:12.803917 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dcd16c50-0624-4b1f-a99f-2c23d8149562 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:12.935626 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-dcd16c50-0624-4b1f-a99f-2c23d8149562 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:11:12.942888 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-dcd16c50-0624-4b1f-a99f-2c23d8149562 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/6dcc72f3-865c-48e2-9ae9-7d91eef84f35" status: 200 len: 1452 microversion: 2.1 time: 0.151694 Nov 16 16:11:12.943451 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 495/973] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:11:12 2021] GET /compute/v2.1/servers/6dcc72f3-865c-48e2-9ae9-7d91eef84f35 => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:11:14.573626 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-dcfe07db-a785-4788-8797-31ff3a3cb169 req-98922955-dd27-4d85-a826-e260211930ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dcc72f3-865c-48e2-9ae9-7d91eef84f35", "tag": "10f5fb1e-fddd-4de2-b420-4ed412992643"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:11:14.575880 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:11:14.575880 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Nov 16 16:11:14.583714 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-dcfe07db-a785-4788-8797-31ff3a3cb169 req-98922955-dd27-4d85-a826-e260211930ae service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:14.584167 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-dcfe07db-a785-4788-8797-31ff3a3cb169 req-98922955-dd27-4d85-a826-e260211930ae service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:14.595240 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-dcfe07db-a785-4788-8797-31ff3a3cb169 req-98922955-dd27-4d85-a826-e260211930ae service nova] Creating event network-changed:10f5fb1e-fddd-4de2-b420-4ed412992643 for instance 6dcc72f3-865c-48e2-9ae9-7d91eef84f35 on hv-cinder-81809 Nov 16 16:11:14.600311 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-dcfe07db-a785-4788-8797-31ff3a3cb169 req-98922955-dd27-4d85-a826-e260211930ae service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031106 Nov 16 16:11:14.600897 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 479/974] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:11:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:11:17.691721 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f49daa17-0ee7-4713-9b72-5dc01b2ad829 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1329014937", "imageRef": "7c3bd8e0-8d7e-4cf7-90db-742c4f55e405", "flavorRef": "452", "networks": [{"uuid": "63a82f94-756b-4c4e-a3fc-7d796125074b"}]}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:11:17.742755 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.network.neutron [None req-f49daa17-0ee7-4713-9b72-5dc01b2ad829 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] validate_networks() for [('63a82f94-756b-4c4e-a3fc-7d796125074b', None, None, None, None, None)] {{(pid=116084) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 16:11:18.103184 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-f49daa17-0ee7-4713-9b72-5dc01b2ad829 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Flavor limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 16:11:18.103659 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-f49daa17-0ee7-4713-9b72-5dc01b2ad829 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Image limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 16:11:18.104170 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-f49daa17-0ee7-4713-9b72-5dc01b2ad829 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Flavor pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 16:11:18.104580 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-f49daa17-0ee7-4713-9b72-5dc01b2ad829 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Image pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 16:11:18.104991 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-f49daa17-0ee7-4713-9b72-5dc01b2ad829 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 16:11:18.113524 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f49daa17-0ee7-4713-9b72-5dc01b2ad829 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:18.113973 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f49daa17-0ee7-4713-9b72-5dc01b2ad829 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:18.114781 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f49daa17-0ee7-4713-9b72-5dc01b2ad829 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:18.115220 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f49daa17-0ee7-4713-9b72-5dc01b2ad829 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:18.132196 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-f49daa17-0ee7-4713-9b72-5dc01b2ad829 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Getting quotas for project 261a56c38b564260b994aa1efc3fc829. Resources: {'instances', 'ram', 'cores'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:11:18.136665 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-f49daa17-0ee7-4713-9b72-5dc01b2ad829 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Getting quotas for user 1ff420f6aa9044889cdc43c6e2926d12 and project 261a56c38b564260b994aa1efc3fc829. Resources: {'instances', 'ram', 'cores'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:11:18.147088 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f49daa17-0ee7-4713-9b72-5dc01b2ad829 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Going to run 1 instances... {{(pid=116084) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 16:11:18.149606 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f49daa17-0ee7-4713-9b72-5dc01b2ad829 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 0556b1c3-b8f8-41ca-85b8-2852285a49f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c3bd8e0-8d7e-4cf7-90db-742c4f55e405',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116084) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 16:11:18.193339 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f49daa17-0ee7-4713-9b72-5dc01b2ad829 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.505804 Nov 16 16:11:18.193972 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 496/975] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 16 16:11:17 2021] POST /compute/v2.1/servers => generated 380 bytes in 507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 16:11:18.205562 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-61dfddb2-d024-4270-a713-7a7fff6eba48 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:11:18.206367 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-61dfddb2-d024-4270-a713-7a7fff6eba48 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 0556b1c3-b8f8-41ca-85b8-2852285a49f9] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:18.268588 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-61dfddb2-d024-4270-a713-7a7fff6eba48 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff420f6aa9044889cdc43c6e2926d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a56c38b564260b994aa1efc3fc829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:11:18.275866 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-61dfddb2-d024-4270-a713-7a7fff6eba48 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/0556b1c3-b8f8-41ca-85b8-2852285a49f9" status: 200 len: 1218 microversion: 2.1 time: 0.074460 Nov 16 16:11:18.276526 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 480/976] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:11:18 2021] GET /compute/v2.1/servers/0556b1c3-b8f8-41ca-85b8-2852285a49f9 => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:11:19.293371 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-339d8950-4015-4c90-908c-36e003c85ffe tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:11:19.293979 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-339d8950-4015-4c90-908c-36e003c85ffe tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 0556b1c3-b8f8-41ca-85b8-2852285a49f9] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:19.300883 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-339d8950-4015-4c90-908c-36e003c85ffe tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:19.301330 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-339d8950-4015-4c90-908c-36e003c85ffe tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:19.302130 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-339d8950-4015-4c90-908c-36e003c85ffe tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:19.302530 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-339d8950-4015-4c90-908c-36e003c85ffe tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:19.374924 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-339d8950-4015-4c90-908c-36e003c85ffe tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff420f6aa9044889cdc43c6e2926d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a56c38b564260b994aa1efc3fc829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:11:19.382112 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-339d8950-4015-4c90-908c-36e003c85ffe tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/0556b1c3-b8f8-41ca-85b8-2852285a49f9" status: 200 len: 1276 microversion: 2.1 time: 0.093492 Nov 16 16:11:19.382720 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 497/977] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:11:19 2021] GET /compute/v2.1/servers/0556b1c3-b8f8-41ca-85b8-2852285a49f9 => generated 1276 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:11:20.404062 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-206264e2-e895-4e60-91d4-3f015695bafe tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:11:20.405247 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-206264e2-e895-4e60-91d4-3f015695bafe tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 0556b1c3-b8f8-41ca-85b8-2852285a49f9] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:20.411657 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-206264e2-e895-4e60-91d4-3f015695bafe tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:20.412173 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-206264e2-e895-4e60-91d4-3f015695bafe tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:20.413017 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-206264e2-e895-4e60-91d4-3f015695bafe tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:20.413451 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-206264e2-e895-4e60-91d4-3f015695bafe tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:20.633121 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-206264e2-e895-4e60-91d4-3f015695bafe tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff420f6aa9044889cdc43c6e2926d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a56c38b564260b994aa1efc3fc829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:11:20.640977 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-206264e2-e895-4e60-91d4-3f015695bafe tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/0556b1c3-b8f8-41ca-85b8-2852285a49f9" status: 200 len: 1318 microversion: 2.1 time: 0.241448 Nov 16 16:11:20.641961 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 481/978] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:11:20 2021] GET /compute/v2.1/servers/0556b1c3-b8f8-41ca-85b8-2852285a49f9 => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:11:20.757796 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-0cd9a7c7-da65-40d9-b899-cce8102da333 req-4c5f37d9-9239-486d-a22d-83445c7023d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0556b1c3-b8f8-41ca-85b8-2852285a49f9", "tag": "c7e4fe7f-71cc-49de-b03e-045a57243e92"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:11:20.761055 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:11:20.761055 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Nov 16 16:11:20.772156 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-0cd9a7c7-da65-40d9-b899-cce8102da333 req-4c5f37d9-9239-486d-a22d-83445c7023d5 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:20.773248 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-0cd9a7c7-da65-40d9-b899-cce8102da333 req-4c5f37d9-9239-486d-a22d-83445c7023d5 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:20.788192 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-0cd9a7c7-da65-40d9-b899-cce8102da333 req-4c5f37d9-9239-486d-a22d-83445c7023d5 service nova] Creating event network-changed:c7e4fe7f-71cc-49de-b03e-045a57243e92 for instance 0556b1c3-b8f8-41ca-85b8-2852285a49f9 on hv-cinder-81809 Nov 16 16:11:20.793913 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-0cd9a7c7-da65-40d9-b899-cce8102da333 req-4c5f37d9-9239-486d-a22d-83445c7023d5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040690 Nov 16 16:11:20.794826 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 498/979] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:11:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:11:21.657785 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-91e0f21e-fea0-496f-ae7b-73f8aa7623b2 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:11:21.658422 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-91e0f21e-fea0-496f-ae7b-73f8aa7623b2 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 0556b1c3-b8f8-41ca-85b8-2852285a49f9] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:21.664769 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-91e0f21e-fea0-496f-ae7b-73f8aa7623b2 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:21.665207 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-91e0f21e-fea0-496f-ae7b-73f8aa7623b2 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:21.666044 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-91e0f21e-fea0-496f-ae7b-73f8aa7623b2 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:21.667084 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-91e0f21e-fea0-496f-ae7b-73f8aa7623b2 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:21.797838 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-91e0f21e-fea0-496f-ae7b-73f8aa7623b2 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff420f6aa9044889cdc43c6e2926d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a56c38b564260b994aa1efc3fc829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:11:21.804927 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-91e0f21e-fea0-496f-ae7b-73f8aa7623b2 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/0556b1c3-b8f8-41ca-85b8-2852285a49f9" status: 200 len: 1318 microversion: 2.1 time: 0.150757 Nov 16 16:11:21.805490 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 482/980] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:11:21 2021] GET /compute/v2.1/servers/0556b1c3-b8f8-41ca-85b8-2852285a49f9 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:11:22.823787 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c9838e34-5f94-4da0-a6a7-53e3363288ba tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:11:22.824489 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c9838e34-5f94-4da0-a6a7-53e3363288ba tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 0556b1c3-b8f8-41ca-85b8-2852285a49f9] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:22.830447 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c9838e34-5f94-4da0-a6a7-53e3363288ba tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:22.830884 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c9838e34-5f94-4da0-a6a7-53e3363288ba tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:22.831687 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c9838e34-5f94-4da0-a6a7-53e3363288ba tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:22.832118 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c9838e34-5f94-4da0-a6a7-53e3363288ba tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:22.978728 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-c9838e34-5f94-4da0-a6a7-53e3363288ba tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff420f6aa9044889cdc43c6e2926d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a56c38b564260b994aa1efc3fc829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:11:22.985914 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c9838e34-5f94-4da0-a6a7-53e3363288ba tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/0556b1c3-b8f8-41ca-85b8-2852285a49f9" status: 200 len: 1318 microversion: 2.1 time: 0.167587 Nov 16 16:11:22.986483 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 499/981] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:11:22 2021] GET /compute/v2.1/servers/0556b1c3-b8f8-41ca-85b8-2852285a49f9 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:11:24.001766 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-d6f13dee-6f92-48da-aec4-a5dac7cd6c76 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:11:24.003048 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-d6f13dee-6f92-48da-aec4-a5dac7cd6c76 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 0556b1c3-b8f8-41ca-85b8-2852285a49f9] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:24.012249 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d6f13dee-6f92-48da-aec4-a5dac7cd6c76 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:24.012939 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d6f13dee-6f92-48da-aec4-a5dac7cd6c76 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:24.013891 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d6f13dee-6f92-48da-aec4-a5dac7cd6c76 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:24.014493 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d6f13dee-6f92-48da-aec4-a5dac7cd6c76 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:24.154509 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-d6f13dee-6f92-48da-aec4-a5dac7cd6c76 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff420f6aa9044889cdc43c6e2926d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a56c38b564260b994aa1efc3fc829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:11:24.162380 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-d6f13dee-6f92-48da-aec4-a5dac7cd6c76 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/0556b1c3-b8f8-41ca-85b8-2852285a49f9" status: 200 len: 1318 microversion: 2.1 time: 0.164161 Nov 16 16:11:24.163197 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 483/982] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:11:23 2021] GET /compute/v2.1/servers/0556b1c3-b8f8-41ca-85b8-2852285a49f9 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:11:25.179663 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d60ebe63-adb4-4187-a188-737339f35578 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:11:25.180274 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d60ebe63-adb4-4187-a188-737339f35578 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 0556b1c3-b8f8-41ca-85b8-2852285a49f9] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:25.188275 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d60ebe63-adb4-4187-a188-737339f35578 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:25.188717 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d60ebe63-adb4-4187-a188-737339f35578 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:25.189517 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d60ebe63-adb4-4187-a188-737339f35578 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:25.189956 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d60ebe63-adb4-4187-a188-737339f35578 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:25.371300 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d60ebe63-adb4-4187-a188-737339f35578 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff420f6aa9044889cdc43c6e2926d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a56c38b564260b994aa1efc3fc829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:11:25.381918 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d60ebe63-adb4-4187-a188-737339f35578 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/0556b1c3-b8f8-41ca-85b8-2852285a49f9" status: 200 len: 1318 microversion: 2.1 time: 0.205776 Nov 16 16:11:25.391697 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 500/983] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:11:25 2021] GET /compute/v2.1/servers/0556b1c3-b8f8-41ca-85b8-2852285a49f9 => generated 1318 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:11:26.399104 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-71e385bd-8dab-48ff-961e-9bd562249768 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:11:26.401962 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-71e385bd-8dab-48ff-961e-9bd562249768 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 0556b1c3-b8f8-41ca-85b8-2852285a49f9] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:26.410326 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-71e385bd-8dab-48ff-961e-9bd562249768 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:26.411285 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-71e385bd-8dab-48ff-961e-9bd562249768 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:26.412351 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-71e385bd-8dab-48ff-961e-9bd562249768 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:26.413119 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-71e385bd-8dab-48ff-961e-9bd562249768 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:26.649966 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-71e385bd-8dab-48ff-961e-9bd562249768 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff420f6aa9044889cdc43c6e2926d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a56c38b564260b994aa1efc3fc829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:11:26.661088 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-71e385bd-8dab-48ff-961e-9bd562249768 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/0556b1c3-b8f8-41ca-85b8-2852285a49f9" status: 200 len: 1318 microversion: 2.1 time: 0.265390 Nov 16 16:11:26.662387 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 484/984] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:11:26 2021] GET /compute/v2.1/servers/0556b1c3-b8f8-41ca-85b8-2852285a49f9 => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:11:27.408006 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-ca9dc9cc-dead-4148-bf65-ba34cbffb7fc req-893f841e-0f04-4ded-b398-74ab87cdd7a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0556b1c3-b8f8-41ca-85b8-2852285a49f9", "name": "network-vif-plugged", "status": "completed", "tag": "c7e4fe7f-71cc-49de-b03e-045a57243e92"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:11:27.409515 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:11:27.409515 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Nov 16 16:11:27.417942 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-ca9dc9cc-dead-4148-bf65-ba34cbffb7fc req-893f841e-0f04-4ded-b398-74ab87cdd7a4 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:27.418495 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-ca9dc9cc-dead-4148-bf65-ba34cbffb7fc req-893f841e-0f04-4ded-b398-74ab87cdd7a4 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:27.430874 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-ca9dc9cc-dead-4148-bf65-ba34cbffb7fc req-893f841e-0f04-4ded-b398-74ab87cdd7a4 service nova] Creating event network-vif-plugged:c7e4fe7f-71cc-49de-b03e-045a57243e92 for instance 0556b1c3-b8f8-41ca-85b8-2852285a49f9 on hv-cinder-81809 Nov 16 16:11:27.437274 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-ca9dc9cc-dead-4148-bf65-ba34cbffb7fc req-893f841e-0f04-4ded-b398-74ab87cdd7a4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032676 Nov 16 16:11:27.438436 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 501/985] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:11:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:11:27.683786 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-638d749b-46fc-47c9-addb-2349b1c11f06 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:11:27.684402 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-638d749b-46fc-47c9-addb-2349b1c11f06 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 0556b1c3-b8f8-41ca-85b8-2852285a49f9] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:27.692575 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-638d749b-46fc-47c9-addb-2349b1c11f06 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:27.693010 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-638d749b-46fc-47c9-addb-2349b1c11f06 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:27.693795 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-638d749b-46fc-47c9-addb-2349b1c11f06 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:27.694219 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-638d749b-46fc-47c9-addb-2349b1c11f06 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:27.883019 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-638d749b-46fc-47c9-addb-2349b1c11f06 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff420f6aa9044889cdc43c6e2926d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a56c38b564260b994aa1efc3fc829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:11:27.891426 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-638d749b-46fc-47c9-addb-2349b1c11f06 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/0556b1c3-b8f8-41ca-85b8-2852285a49f9" status: 200 len: 1318 microversion: 2.1 time: 0.215551 Nov 16 16:11:27.892663 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 485/986] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:11:27 2021] GET /compute/v2.1/servers/0556b1c3-b8f8-41ca-85b8-2852285a49f9 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:11:28.925577 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-58457691-c0ca-4903-8048-2178bd71ff16 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:11:28.937503 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-58457691-c0ca-4903-8048-2178bd71ff16 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 0556b1c3-b8f8-41ca-85b8-2852285a49f9] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:28.945242 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-58457691-c0ca-4903-8048-2178bd71ff16 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:28.946028 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-58457691-c0ca-4903-8048-2178bd71ff16 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:28.948705 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-58457691-c0ca-4903-8048-2178bd71ff16 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:28.949351 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-58457691-c0ca-4903-8048-2178bd71ff16 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:29.143807 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-58457691-c0ca-4903-8048-2178bd71ff16 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff420f6aa9044889cdc43c6e2926d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a56c38b564260b994aa1efc3fc829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:11:29.151345 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-58457691-c0ca-4903-8048-2178bd71ff16 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/0556b1c3-b8f8-41ca-85b8-2852285a49f9" status: 200 len: 1318 microversion: 2.1 time: 0.242642 Nov 16 16:11:29.151949 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 502/987] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:11:28 2021] GET /compute/v2.1/servers/0556b1c3-b8f8-41ca-85b8-2852285a49f9 => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:11:30.169988 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-22ca6b2b-81cf-4ec4-8fa5-8d82c096ef8e tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:11:30.171874 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-22ca6b2b-81cf-4ec4-8fa5-8d82c096ef8e tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 0556b1c3-b8f8-41ca-85b8-2852285a49f9] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:30.179113 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-22ca6b2b-81cf-4ec4-8fa5-8d82c096ef8e tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:30.179681 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-22ca6b2b-81cf-4ec4-8fa5-8d82c096ef8e tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:30.180896 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-22ca6b2b-81cf-4ec4-8fa5-8d82c096ef8e tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:30.182749 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-22ca6b2b-81cf-4ec4-8fa5-8d82c096ef8e tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:30.469759 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-22ca6b2b-81cf-4ec4-8fa5-8d82c096ef8e tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff420f6aa9044889cdc43c6e2926d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a56c38b564260b994aa1efc3fc829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:11:30.514322 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-22ca6b2b-81cf-4ec4-8fa5-8d82c096ef8e tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/0556b1c3-b8f8-41ca-85b8-2852285a49f9" status: 200 len: 1509 microversion: 2.1 time: 0.349774 Nov 16 16:11:30.518467 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 486/988] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:11:30 2021] GET /compute/v2.1/servers/0556b1c3-b8f8-41ca-85b8-2852285a49f9 => generated 1509 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:11:30.537581 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ea0ed091-fe46-47af-9b1f-9cee57afb822 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c556fef4-8685-471b-ac4b-c58480c3d7ca"}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:11:30.539095 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ea0ed091-fe46-47af-9b1f-9cee57afb822 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 0556b1c3-b8f8-41ca-85b8-2852285a49f9] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:30.564136 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ea0ed091-fe46-47af-9b1f-9cee57afb822 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:30.564948 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ea0ed091-fe46-47af-9b1f-9cee57afb822 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:30.565896 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ea0ed091-fe46-47af-9b1f-9cee57afb822 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:30.566699 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ea0ed091-fe46-47af-9b1f-9cee57afb822 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:30.725849 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-ea0ed091-fe46-47af-9b1f-9cee57afb822 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] HTTP exception thrown: Invalid volume: volume c556fef4-8685-471b-ac4b-c58480c3d7ca is already attached to instances: 77b84f3a-873d-4d5b-88c1-655bc337610e Nov 16 16:11:30.727208 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ea0ed091-fe46-47af-9b1f-9cee57afb822 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Returning 400 to user: Invalid volume: volume c556fef4-8685-471b-ac4b-c58480c3d7ca is already attached to instances: 77b84f3a-873d-4d5b-88c1-655bc337610e {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:11:30.730641 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ea0ed091-fe46-47af-9b1f-9cee57afb822 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "POST /compute/v2.1/servers/0556b1c3-b8f8-41ca-85b8-2852285a49f9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.199431 Nov 16 16:11:30.731882 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 503/989] 10.222.0.46 () {60 vars in 1322 bytes} [Tue Nov 16 16:11:30 2021] POST /compute/v2.1/servers/0556b1c3-b8f8-41ca-85b8-2852285a49f9/os-volume_attachments => generated 174 bytes in 201 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 16 16:11:30.827935 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-0024f8f6-5ff8-459b-9bc1-e50e8a875633 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:11:30.828442 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-0024f8f6-5ff8-459b-9bc1-e50e8a875633 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 77b84f3a-873d-4d5b-88c1-655bc337610e] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:30.834418 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0024f8f6-5ff8-459b-9bc1-e50e8a875633 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:30.835121 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0024f8f6-5ff8-459b-9bc1-e50e8a875633 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:30.836225 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0024f8f6-5ff8-459b-9bc1-e50e8a875633 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:30.836857 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0024f8f6-5ff8-459b-9bc1-e50e8a875633 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:30.971662 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.objects.instance [None req-0024f8f6-5ff8-459b-9bc1-e50e8a875633 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lazy-loading 'services' on Instance uuid 77b84f3a-873d-4d5b-88c1-655bc337610e {{(pid=116085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:11:31.085731 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-0024f8f6-5ff8-459b-9bc1-e50e8a875633 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "DELETE /compute/v2.1/servers/77b84f3a-873d-4d5b-88c1-655bc337610e/os-volume_attachments/c556fef4-8685-471b-ac4b-c58480c3d7ca" status: 202 len: 0 microversion: 2.1 time: 0.261312 Nov 16 16:11:31.086939 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 487/990] 10.222.0.46 () {58 vars in 1415 bytes} [Tue Nov 16 16:11:30 2021] DELETE /compute/v2.1/servers/77b84f3a-873d-4d5b-88c1-655bc337610e/os-volume_attachments/c556fef4-8685-471b-ac4b-c58480c3d7ca => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:11:31.096311 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-34b9d1c6-1633-4c5d-b590-d1756b33bb07 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:11:31.097545 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-34b9d1c6-1633-4c5d-b590-d1756b33bb07 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 77b84f3a-873d-4d5b-88c1-655bc337610e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:31.109939 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-34b9d1c6-1633-4c5d-b590-d1756b33bb07 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:31.112168 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-34b9d1c6-1633-4c5d-b590-d1756b33bb07 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:31.113390 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-34b9d1c6-1633-4c5d-b590-d1756b33bb07 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:31.124330 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-34b9d1c6-1633-4c5d-b590-d1756b33bb07 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:31.169872 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-34b9d1c6-1633-4c5d-b590-d1756b33bb07 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/77b84f3a-873d-4d5b-88c1-655bc337610e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078291 Nov 16 16:11:31.171083 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 504/991] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 16 16:11:31 2021] GET /compute/v2.1/servers/77b84f3a-873d-4d5b-88c1-655bc337610e/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:11:32.185084 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-51517a69-e410-4019-b488-d4365a085dcc tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:11:32.186823 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-51517a69-e410-4019-b488-d4365a085dcc tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 77b84f3a-873d-4d5b-88c1-655bc337610e] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:32.193171 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-51517a69-e410-4019-b488-d4365a085dcc tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:32.193664 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-51517a69-e410-4019-b488-d4365a085dcc tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:32.194442 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-51517a69-e410-4019-b488-d4365a085dcc tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:32.194900 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-51517a69-e410-4019-b488-d4365a085dcc tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:32.227708 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-51517a69-e410-4019-b488-d4365a085dcc tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/77b84f3a-873d-4d5b-88c1-655bc337610e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049435 Nov 16 16:11:32.228565 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 488/992] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 16 16:11:32 2021] GET /compute/v2.1/servers/77b84f3a-873d-4d5b-88c1-655bc337610e/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 16:11:32.405971 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-9a4f721e-e6df-4285-bb5c-cfeff8d6a08b tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-115516133", "imageRef": "7c3bd8e0-8d7e-4cf7-90db-742c4f55e405", "flavorRef": "452", "networks": [{"uuid": "63a82f94-756b-4c4e-a3fc-7d796125074b"}]}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:11:32.474265 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.network.neutron [None req-9a4f721e-e6df-4285-bb5c-cfeff8d6a08b tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] validate_networks() for [('63a82f94-756b-4c4e-a3fc-7d796125074b', None, None, None, None, None)] {{(pid=116084) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 16:11:32.968596 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-2f1c34e8-8268-4adc-abfb-e958ba7200c5 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Action: 'create', calling method: .version_select at 0x7f113c44b8b0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1370474868"}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:11:32.974310 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-9a4f721e-e6df-4285-bb5c-cfeff8d6a08b tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Flavor limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 16:11:32.974737 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-9a4f721e-e6df-4285-bb5c-cfeff8d6a08b tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Image limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 16:11:32.975213 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-9a4f721e-e6df-4285-bb5c-cfeff8d6a08b tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Flavor pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 16:11:32.975652 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-9a4f721e-e6df-4285-bb5c-cfeff8d6a08b tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Image pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 16:11:32.976270 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-9a4f721e-e6df-4285-bb5c-cfeff8d6a08b tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 16:11:32.986707 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9a4f721e-e6df-4285-bb5c-cfeff8d6a08b tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:32.987146 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9a4f721e-e6df-4285-bb5c-cfeff8d6a08b tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:32.987986 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9a4f721e-e6df-4285-bb5c-cfeff8d6a08b tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:32.988599 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9a4f721e-e6df-4285-bb5c-cfeff8d6a08b tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:32.989883 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-2f1c34e8-8268-4adc-abfb-e958ba7200c5 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Getting quotas for project df73e9a151d74cbfa33bed295c7c3be3. Resources: {'key_pairs'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:11:32.993816 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-2f1c34e8-8268-4adc-abfb-e958ba7200c5 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Getting quotas for user 59e4dc563e8e4d80817bb8b3937768b2 and project df73e9a151d74cbfa33bed295c7c3be3. Resources: {'key_pairs'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:11:33.005527 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-9a4f721e-e6df-4285-bb5c-cfeff8d6a08b tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Getting quotas for project 261a56c38b564260b994aa1efc3fc829. Resources: {'instances', 'ram', 'cores'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:11:33.010083 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-9a4f721e-e6df-4285-bb5c-cfeff8d6a08b tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Getting quotas for user 1ff420f6aa9044889cdc43c6e2926d12 and project 261a56c38b564260b994aa1efc3fc829. Resources: {'instances', 'ram', 'cores'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:11:33.021794 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-9a4f721e-e6df-4285-bb5c-cfeff8d6a08b tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Going to run 1 instances... {{(pid=116084) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 16:11:33.024282 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-9a4f721e-e6df-4285-bb5c-cfeff8d6a08b tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 5251b895-35a2-4a27-ae13-9ef1995cbc9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c3bd8e0-8d7e-4cf7-90db-742c4f55e405',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116084) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 16:11:33.071668 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-9a4f721e-e6df-4285-bb5c-cfeff8d6a08b tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.669788 Nov 16 16:11:33.072686 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 505/993] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 16 16:11:32 2021] POST /compute/v2.1/servers => generated 380 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 16:11:33.082721 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7bca9441-eca1-4ff4-a18b-f59825e51079 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:11:33.083647 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-7bca9441-eca1-4ff4-a18b-f59825e51079 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 5251b895-35a2-4a27-ae13-9ef1995cbc9e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:33.143242 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7bca9441-eca1-4ff4-a18b-f59825e51079 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff420f6aa9044889cdc43c6e2926d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a56c38b564260b994aa1efc3fc829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:11:33.150831 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-7bca9441-eca1-4ff4-a18b-f59825e51079 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/5251b895-35a2-4a27-ae13-9ef1995cbc9e" status: 200 len: 1217 microversion: 2.1 time: 0.071871 Nov 16 16:11:33.161774 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 506/994] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:11:33 2021] GET /compute/v2.1/servers/5251b895-35a2-4a27-ae13-9ef1995cbc9e => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:11:33.625547 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-2f1c34e8-8268-4adc-abfb-e958ba7200c5 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Getting quotas for project df73e9a151d74cbfa33bed295c7c3be3. Resources: {'key_pairs'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:11:33.629333 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-2f1c34e8-8268-4adc-abfb-e958ba7200c5 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Getting quotas for user 59e4dc563e8e4d80817bb8b3937768b2 and project df73e9a151d74cbfa33bed295c7c3be3. Resources: {'key_pairs'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:11:33.642884 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-2f1c34e8-8268-4adc-abfb-e958ba7200c5 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.863380 Nov 16 16:11:33.644047 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 489/995] 10.222.0.46 () {60 vars in 1157 bytes} [Tue Nov 16 16:11:32 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:11:34.168585 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a14b160a-8bde-4c18-affb-38ea2d381b70 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:11:34.169197 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-a14b160a-8bde-4c18-affb-38ea2d381b70 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 5251b895-35a2-4a27-ae13-9ef1995cbc9e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:34.176403 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a14b160a-8bde-4c18-affb-38ea2d381b70 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:34.176857 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a14b160a-8bde-4c18-affb-38ea2d381b70 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:34.177925 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a14b160a-8bde-4c18-affb-38ea2d381b70 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:34.178547 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a14b160a-8bde-4c18-affb-38ea2d381b70 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:34.267693 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-a14b160a-8bde-4c18-affb-38ea2d381b70 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff420f6aa9044889cdc43c6e2926d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a56c38b564260b994aa1efc3fc829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:11:34.276208 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-a14b160a-8bde-4c18-affb-38ea2d381b70 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/5251b895-35a2-4a27-ae13-9ef1995cbc9e" status: 200 len: 1277 microversion: 2.1 time: 0.111877 Nov 16 16:11:34.277077 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 507/996] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:11:34 2021] GET /compute/v2.1/servers/5251b895-35a2-4a27-ae13-9ef1995cbc9e => generated 1277 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:11:35.295122 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-32f53dea-c5ca-48dd-ab67-852fca4ec051 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:11:35.296927 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-32f53dea-c5ca-48dd-ab67-852fca4ec051 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 5251b895-35a2-4a27-ae13-9ef1995cbc9e] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:35.309855 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-32f53dea-c5ca-48dd-ab67-852fca4ec051 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:35.310665 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-32f53dea-c5ca-48dd-ab67-852fca4ec051 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:35.311729 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-32f53dea-c5ca-48dd-ab67-852fca4ec051 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:35.312853 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-32f53dea-c5ca-48dd-ab67-852fca4ec051 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:35.639018 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-32f53dea-c5ca-48dd-ab67-852fca4ec051 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff420f6aa9044889cdc43c6e2926d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a56c38b564260b994aa1efc3fc829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:11:35.646608 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-32f53dea-c5ca-48dd-ab67-852fca4ec051 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/5251b895-35a2-4a27-ae13-9ef1995cbc9e" status: 200 len: 1317 microversion: 2.1 time: 0.356422 Nov 16 16:11:35.647829 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 490/997] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:11:35 2021] GET /compute/v2.1/servers/5251b895-35a2-4a27-ae13-9ef1995cbc9e => generated 1317 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:11:36.103959 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-17622cce-22da-4871-88f6-14701ea71e6e req-4b6f2395-6be2-47a3-bb35-c057e531cfc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5251b895-35a2-4a27-ae13-9ef1995cbc9e", "tag": "8eeb4aa5-da20-4dc1-9493-f6a58cbdc337"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:11:36.110030 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:11:36.110030 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Nov 16 16:11:36.126925 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-17622cce-22da-4871-88f6-14701ea71e6e req-4b6f2395-6be2-47a3-bb35-c057e531cfc4 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:36.127361 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-17622cce-22da-4871-88f6-14701ea71e6e req-4b6f2395-6be2-47a3-bb35-c057e531cfc4 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:36.139536 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-17622cce-22da-4871-88f6-14701ea71e6e req-4b6f2395-6be2-47a3-bb35-c057e531cfc4 service nova] Creating event network-changed:8eeb4aa5-da20-4dc1-9493-f6a58cbdc337 for instance 5251b895-35a2-4a27-ae13-9ef1995cbc9e on hv-cinder-81809 Nov 16 16:11:36.145314 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-17622cce-22da-4871-88f6-14701ea71e6e req-4b6f2395-6be2-47a3-bb35-c057e531cfc4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051290 Nov 16 16:11:36.146017 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 508/998] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:11:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:11:36.666233 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-cc939f70-1e87-40a5-8ccb-9add5b078437 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:11:36.671228 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-cc939f70-1e87-40a5-8ccb-9add5b078437 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 5251b895-35a2-4a27-ae13-9ef1995cbc9e] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:36.683764 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cc939f70-1e87-40a5-8ccb-9add5b078437 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:36.684684 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cc939f70-1e87-40a5-8ccb-9add5b078437 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:36.687293 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cc939f70-1e87-40a5-8ccb-9add5b078437 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:36.688248 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cc939f70-1e87-40a5-8ccb-9add5b078437 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:36.998444 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-cc939f70-1e87-40a5-8ccb-9add5b078437 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff420f6aa9044889cdc43c6e2926d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a56c38b564260b994aa1efc3fc829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:11:37.010032 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-cc939f70-1e87-40a5-8ccb-9add5b078437 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/5251b895-35a2-4a27-ae13-9ef1995cbc9e" status: 200 len: 1317 microversion: 2.1 time: 0.349323 Nov 16 16:11:37.021135 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 491/999] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:11:36 2021] GET /compute/v2.1/servers/5251b895-35a2-4a27-ae13-9ef1995cbc9e => generated 1317 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:11:38.029093 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-dfa10558-fc91-46cd-911e-249a653b057a tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:11:38.029807 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-dfa10558-fc91-46cd-911e-249a653b057a tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 5251b895-35a2-4a27-ae13-9ef1995cbc9e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:38.036184 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dfa10558-fc91-46cd-911e-249a653b057a tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:38.036639 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dfa10558-fc91-46cd-911e-249a653b057a tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:38.037433 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dfa10558-fc91-46cd-911e-249a653b057a tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:38.037872 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dfa10558-fc91-46cd-911e-249a653b057a tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:38.177421 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-dfa10558-fc91-46cd-911e-249a653b057a tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff420f6aa9044889cdc43c6e2926d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a56c38b564260b994aa1efc3fc829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:11:38.185219 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-dfa10558-fc91-46cd-911e-249a653b057a tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/5251b895-35a2-4a27-ae13-9ef1995cbc9e" status: 200 len: 1317 microversion: 2.1 time: 0.161026 Nov 16 16:11:38.185788 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 509/1000] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:11:38 2021] GET /compute/v2.1/servers/5251b895-35a2-4a27-ae13-9ef1995cbc9e => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:11:39.203684 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-2a7cdc89-e296-48b4-ac4f-08b6cf068ba8 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:11:39.204236 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-2a7cdc89-e296-48b4-ac4f-08b6cf068ba8 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 5251b895-35a2-4a27-ae13-9ef1995cbc9e] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:39.210735 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2a7cdc89-e296-48b4-ac4f-08b6cf068ba8 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:39.211185 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2a7cdc89-e296-48b4-ac4f-08b6cf068ba8 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:39.212017 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2a7cdc89-e296-48b4-ac4f-08b6cf068ba8 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:39.212773 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2a7cdc89-e296-48b4-ac4f-08b6cf068ba8 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:39.348006 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-2a7cdc89-e296-48b4-ac4f-08b6cf068ba8 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff420f6aa9044889cdc43c6e2926d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a56c38b564260b994aa1efc3fc829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:11:39.355810 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-2a7cdc89-e296-48b4-ac4f-08b6cf068ba8 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/5251b895-35a2-4a27-ae13-9ef1995cbc9e" status: 200 len: 1317 microversion: 2.1 time: 0.156768 Nov 16 16:11:39.356386 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 492/1001] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:11:39 2021] GET /compute/v2.1/servers/5251b895-35a2-4a27-ae13-9ef1995cbc9e => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:11:40.374409 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-af5740a3-655b-4028-adff-d2aabd913bc4 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:11:40.374968 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-af5740a3-655b-4028-adff-d2aabd913bc4 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 5251b895-35a2-4a27-ae13-9ef1995cbc9e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:40.381130 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-af5740a3-655b-4028-adff-d2aabd913bc4 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:40.381568 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-af5740a3-655b-4028-adff-d2aabd913bc4 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:40.382329 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-af5740a3-655b-4028-adff-d2aabd913bc4 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:40.382759 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-af5740a3-655b-4028-adff-d2aabd913bc4 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:40.519594 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-af5740a3-655b-4028-adff-d2aabd913bc4 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff420f6aa9044889cdc43c6e2926d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a56c38b564260b994aa1efc3fc829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:11:40.526987 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-af5740a3-655b-4028-adff-d2aabd913bc4 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/5251b895-35a2-4a27-ae13-9ef1995cbc9e" status: 200 len: 1317 microversion: 2.1 time: 0.156422 Nov 16 16:11:40.527587 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 510/1002] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:11:40 2021] GET /compute/v2.1/servers/5251b895-35a2-4a27-ae13-9ef1995cbc9e => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:11:40.892327 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-1be2bfd3-901c-4a2b-9605-e47092533388 req-3d9372bb-1c36-4561-8192-dddea750acf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5251b895-35a2-4a27-ae13-9ef1995cbc9e", "name": "network-vif-plugged", "status": "completed", "tag": "8eeb4aa5-da20-4dc1-9493-f6a58cbdc337"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:11:40.893872 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:11:40.893872 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Nov 16 16:11:40.902122 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-1be2bfd3-901c-4a2b-9605-e47092533388 req-3d9372bb-1c36-4561-8192-dddea750acf7 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:40.902561 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-1be2bfd3-901c-4a2b-9605-e47092533388 req-3d9372bb-1c36-4561-8192-dddea750acf7 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:40.913783 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-1be2bfd3-901c-4a2b-9605-e47092533388 req-3d9372bb-1c36-4561-8192-dddea750acf7 service nova] Creating event network-vif-plugged:8eeb4aa5-da20-4dc1-9493-f6a58cbdc337 for instance 5251b895-35a2-4a27-ae13-9ef1995cbc9e on hv-cinder-81809 Nov 16 16:11:40.923415 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-1be2bfd3-901c-4a2b-9605-e47092533388 req-3d9372bb-1c36-4561-8192-dddea750acf7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034780 Nov 16 16:11:40.924214 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 493/1003] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:11:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:11:41.543282 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d65c672b-4b18-4b58-9260-4f9da09caf4d tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:11:41.543891 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d65c672b-4b18-4b58-9260-4f9da09caf4d tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 5251b895-35a2-4a27-ae13-9ef1995cbc9e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:41.550114 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d65c672b-4b18-4b58-9260-4f9da09caf4d tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:41.550561 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d65c672b-4b18-4b58-9260-4f9da09caf4d tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:41.551331 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d65c672b-4b18-4b58-9260-4f9da09caf4d tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:41.551804 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d65c672b-4b18-4b58-9260-4f9da09caf4d tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:41.683630 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d65c672b-4b18-4b58-9260-4f9da09caf4d tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff420f6aa9044889cdc43c6e2926d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a56c38b564260b994aa1efc3fc829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:11:41.690822 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d65c672b-4b18-4b58-9260-4f9da09caf4d tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/5251b895-35a2-4a27-ae13-9ef1995cbc9e" status: 200 len: 1317 microversion: 2.1 time: 0.151694 Nov 16 16:11:41.691389 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 511/1004] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:11:41 2021] GET /compute/v2.1/servers/5251b895-35a2-4a27-ae13-9ef1995cbc9e => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:11:42.708882 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-22d4a454-98c8-4368-be0d-feffb2c84674 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:11:42.709615 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-22d4a454-98c8-4368-be0d-feffb2c84674 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 5251b895-35a2-4a27-ae13-9ef1995cbc9e] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:42.717415 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-22d4a454-98c8-4368-be0d-feffb2c84674 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:42.717857 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-22d4a454-98c8-4368-be0d-feffb2c84674 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:42.718640 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-22d4a454-98c8-4368-be0d-feffb2c84674 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:42.719069 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-22d4a454-98c8-4368-be0d-feffb2c84674 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:42.857335 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-22d4a454-98c8-4368-be0d-feffb2c84674 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff420f6aa9044889cdc43c6e2926d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a56c38b564260b994aa1efc3fc829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:11:42.864652 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-22d4a454-98c8-4368-be0d-feffb2c84674 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/5251b895-35a2-4a27-ae13-9ef1995cbc9e" status: 200 len: 1507 microversion: 2.1 time: 0.160536 Nov 16 16:11:42.865218 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 494/1005] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:11:42 2021] GET /compute/v2.1/servers/5251b895-35a2-4a27-ae13-9ef1995cbc9e => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:11:44.187994 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-726c6351-9ec3-4d06-906f-4e305ea71fb2 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c520c7c1-eb53-4138-9ab0-f52af2f4f8f1"}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:11:44.189035 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-726c6351-9ec3-4d06-906f-4e305ea71fb2 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 5251b895-35a2-4a27-ae13-9ef1995cbc9e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:44.195209 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-726c6351-9ec3-4d06-906f-4e305ea71fb2 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:44.195693 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-726c6351-9ec3-4d06-906f-4e305ea71fb2 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:44.196460 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-726c6351-9ec3-4d06-906f-4e305ea71fb2 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:44.196888 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-726c6351-9ec3-4d06-906f-4e305ea71fb2 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:44.434439 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-726c6351-9ec3-4d06-906f-4e305ea71fb2 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "POST /compute/v2.1/servers/5251b895-35a2-4a27-ae13-9ef1995cbc9e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.249769 Nov 16 16:11:44.435614 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 512/1006] 10.222.0.46 () {60 vars in 1322 bytes} [Tue Nov 16 16:11:44 2021] POST /compute/v2.1/servers/5251b895-35a2-4a27-ae13-9ef1995cbc9e/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:11:51.905568 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-e958a141-6d5b-4bfa-9d75-6a9be95bec5e tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c520c7c1-eb53-4138-9ab0-f52af2f4f8f1"}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:11:51.906605 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-e958a141-6d5b-4bfa-9d75-6a9be95bec5e tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 5251b895-35a2-4a27-ae13-9ef1995cbc9e] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:51.913076 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e958a141-6d5b-4bfa-9d75-6a9be95bec5e tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:51.913515 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e958a141-6d5b-4bfa-9d75-6a9be95bec5e tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:51.914270 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e958a141-6d5b-4bfa-9d75-6a9be95bec5e tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:51.914694 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e958a141-6d5b-4bfa-9d75-6a9be95bec5e tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:51.991414 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.wsgi [None req-e958a141-6d5b-4bfa-9d75-6a9be95bec5e tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] HTTP exception thrown: Invalid volume: volume c520c7c1-eb53-4138-9ab0-f52af2f4f8f1 is already attached to instances: 5251b895-35a2-4a27-ae13-9ef1995cbc9e Nov 16 16:11:51.992066 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-e958a141-6d5b-4bfa-9d75-6a9be95bec5e tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Returning 400 to user: Invalid volume: volume c520c7c1-eb53-4138-9ab0-f52af2f4f8f1 is already attached to instances: 5251b895-35a2-4a27-ae13-9ef1995cbc9e {{(pid=116085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:11:51.992936 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-e958a141-6d5b-4bfa-9d75-6a9be95bec5e tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "POST /compute/v2.1/servers/5251b895-35a2-4a27-ae13-9ef1995cbc9e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.091465 Nov 16 16:11:51.993482 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 495/1007] 10.222.0.46 () {60 vars in 1322 bytes} [Tue Nov 16 16:11:51 2021] POST /compute/v2.1/servers/5251b895-35a2-4a27-ae13-9ef1995cbc9e/os-volume_attachments => generated 174 bytes in 93 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 16 16:11:52.053423 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-464b35e8-bc63-4a45-9e2c-21ddcb31d9fd tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:11:52.054008 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-464b35e8-bc63-4a45-9e2c-21ddcb31d9fd tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 5251b895-35a2-4a27-ae13-9ef1995cbc9e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:52.060186 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-464b35e8-bc63-4a45-9e2c-21ddcb31d9fd tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:52.060636 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-464b35e8-bc63-4a45-9e2c-21ddcb31d9fd tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:52.061421 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-464b35e8-bc63-4a45-9e2c-21ddcb31d9fd tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:52.061860 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-464b35e8-bc63-4a45-9e2c-21ddcb31d9fd tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:52.138221 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.objects.instance [None req-464b35e8-bc63-4a45-9e2c-21ddcb31d9fd tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lazy-loading 'services' on Instance uuid 5251b895-35a2-4a27-ae13-9ef1995cbc9e {{(pid=116084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:11:52.206724 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-464b35e8-bc63-4a45-9e2c-21ddcb31d9fd tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5251b895-35a2-4a27-ae13-9ef1995cbc9e/os-volume_attachments/c520c7c1-eb53-4138-9ab0-f52af2f4f8f1" status: 202 len: 0 microversion: 2.1 time: 0.157847 Nov 16 16:11:52.207348 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 513/1008] 10.222.0.46 () {58 vars in 1415 bytes} [Tue Nov 16 16:11:52 2021] DELETE /compute/v2.1/servers/5251b895-35a2-4a27-ae13-9ef1995cbc9e/os-volume_attachments/c520c7c1-eb53-4138-9ab0-f52af2f4f8f1 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:11:52.216518 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-756b20b8-6263-4d80-a44d-fd29189d3c84 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:11:52.217478 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-756b20b8-6263-4d80-a44d-fd29189d3c84 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 5251b895-35a2-4a27-ae13-9ef1995cbc9e] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:52.224236 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-756b20b8-6263-4d80-a44d-fd29189d3c84 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:52.224669 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-756b20b8-6263-4d80-a44d-fd29189d3c84 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:52.225497 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-756b20b8-6263-4d80-a44d-fd29189d3c84 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:52.225925 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-756b20b8-6263-4d80-a44d-fd29189d3c84 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:52.258228 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-756b20b8-6263-4d80-a44d-fd29189d3c84 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/5251b895-35a2-4a27-ae13-9ef1995cbc9e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046602 Nov 16 16:11:52.258781 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 496/1009] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 16 16:11:52 2021] GET /compute/v2.1/servers/5251b895-35a2-4a27-ae13-9ef1995cbc9e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:11:53.271165 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-2fc68d55-2415-45d1-a696-db95d2ccb4bd tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:11:53.272245 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-2fc68d55-2415-45d1-a696-db95d2ccb4bd tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 5251b895-35a2-4a27-ae13-9ef1995cbc9e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:53.278661 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2fc68d55-2415-45d1-a696-db95d2ccb4bd tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:53.279166 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2fc68d55-2415-45d1-a696-db95d2ccb4bd tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:53.279914 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2fc68d55-2415-45d1-a696-db95d2ccb4bd tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:53.280352 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2fc68d55-2415-45d1-a696-db95d2ccb4bd tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:53.309138 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-2fc68d55-2415-45d1-a696-db95d2ccb4bd tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/5251b895-35a2-4a27-ae13-9ef1995cbc9e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042575 Nov 16 16:11:53.309706 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 514/1010] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 16 16:11:53 2021] GET /compute/v2.1/servers/5251b895-35a2-4a27-ae13-9ef1995cbc9e/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 16:11:53.402990 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-2141eced-1fde-41f8-a7e3-446bf578c908 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-813026486", "imageRef": "7c3bd8e0-8d7e-4cf7-90db-742c4f55e405", "flavorRef": "452", "networks": [{"uuid": "63a82f94-756b-4c4e-a3fc-7d796125074b"}]}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:11:53.454878 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.network.neutron [None req-2141eced-1fde-41f8-a7e3-446bf578c908 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] validate_networks() for [('63a82f94-756b-4c4e-a3fc-7d796125074b', None, None, None, None, None)] {{(pid=116085) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 16:11:53.826477 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-2141eced-1fde-41f8-a7e3-446bf578c908 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Flavor limits 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 16:11:53.826903 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-2141eced-1fde-41f8-a7e3-446bf578c908 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Image limits 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 16:11:53.827376 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-2141eced-1fde-41f8-a7e3-446bf578c908 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Flavor pref 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 16:11:53.827817 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-2141eced-1fde-41f8-a7e3-446bf578c908 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Image pref 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 16:11:53.828231 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-2141eced-1fde-41f8-a7e3-446bf578c908 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 16:11:53.836964 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2141eced-1fde-41f8-a7e3-446bf578c908 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:53.837408 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2141eced-1fde-41f8-a7e3-446bf578c908 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:53.838214 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2141eced-1fde-41f8-a7e3-446bf578c908 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:53.838654 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2141eced-1fde-41f8-a7e3-446bf578c908 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:53.855345 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-2141eced-1fde-41f8-a7e3-446bf578c908 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Getting quotas for project 261a56c38b564260b994aa1efc3fc829. Resources: {'instances', 'ram', 'cores'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:11:53.859266 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-2141eced-1fde-41f8-a7e3-446bf578c908 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Getting quotas for user 1ff420f6aa9044889cdc43c6e2926d12 and project 261a56c38b564260b994aa1efc3fc829. Resources: {'instances', 'ram', 'cores'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:11:53.869766 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-2141eced-1fde-41f8-a7e3-446bf578c908 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Going to run 1 instances... {{(pid=116085) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 16:11:53.872144 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-2141eced-1fde-41f8-a7e3-446bf578c908 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: e8141c68-3ada-4780-a71e-a344b9383228] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c3bd8e0-8d7e-4cf7-90db-742c4f55e405',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116085) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 16:11:53.915040 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-2141eced-1fde-41f8-a7e3-446bf578c908 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.515973 Nov 16 16:11:53.915719 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 497/1011] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 16 16:11:53 2021] POST /compute/v2.1/servers => generated 380 bytes in 517 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 16:11:53.925271 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d233ac8a-096b-4091-97d8-cbb3a544ba26 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:11:53.925886 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d233ac8a-096b-4091-97d8-cbb3a544ba26 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: e8141c68-3ada-4780-a71e-a344b9383228] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:53.978502 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d233ac8a-096b-4091-97d8-cbb3a544ba26 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff420f6aa9044889cdc43c6e2926d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a56c38b564260b994aa1efc3fc829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:11:53.985111 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d233ac8a-096b-4091-97d8-cbb3a544ba26 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/e8141c68-3ada-4780-a71e-a344b9383228" status: 200 len: 1217 microversion: 2.1 time: 0.063415 Nov 16 16:11:53.985682 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 515/1012] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:11:53 2021] GET /compute/v2.1/servers/e8141c68-3ada-4780-a71e-a344b9383228 => generated 1217 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:11:55.002649 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-d8f3a420-f565-4728-91ab-6b1edb7ac812 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:11:55.003393 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-d8f3a420-f565-4728-91ab-6b1edb7ac812 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: e8141c68-3ada-4780-a71e-a344b9383228] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:55.009586 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d8f3a420-f565-4728-91ab-6b1edb7ac812 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:55.010029 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d8f3a420-f565-4728-91ab-6b1edb7ac812 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:55.010956 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d8f3a420-f565-4728-91ab-6b1edb7ac812 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:55.011564 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d8f3a420-f565-4728-91ab-6b1edb7ac812 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:55.090444 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-d8f3a420-f565-4728-91ab-6b1edb7ac812 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff420f6aa9044889cdc43c6e2926d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a56c38b564260b994aa1efc3fc829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:11:55.097689 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-d8f3a420-f565-4728-91ab-6b1edb7ac812 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/e8141c68-3ada-4780-a71e-a344b9383228" status: 200 len: 1275 microversion: 2.1 time: 0.099507 Nov 16 16:11:55.098261 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 498/1013] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:11:54 2021] GET /compute/v2.1/servers/e8141c68-3ada-4780-a71e-a344b9383228 => generated 1275 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:11:55.601107 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7f6fa150-f77e-463c-86d9-87d32f097159 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-377874154", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1370474868", "security_groups": [{"name": "tempest-secgroup-smoke-1949082711"}], "networks": [{"uuid": "5e1573a3-7c9c-47a0-b82c-386adb674ca5"}], "block_device_mapping_v2": [{"uuid": "08cec199-85b9-4d22-ab7f-9ebe95903a81", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:11:55.789501 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.network.neutron [None req-7f6fa150-f77e-463c-86d9-87d32f097159 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] validate_networks() for [('5e1573a3-7c9c-47a0-b82c-386adb674ca5', None, None, None, None, None)] {{(pid=116084) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 16:11:56.115067 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-fb63385b-a1de-4809-b4fe-7e2d948ffa4a tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:11:56.115777 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-fb63385b-a1de-4809-b4fe-7e2d948ffa4a tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: e8141c68-3ada-4780-a71e-a344b9383228] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:56.123276 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fb63385b-a1de-4809-b4fe-7e2d948ffa4a tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:56.123740 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fb63385b-a1de-4809-b4fe-7e2d948ffa4a tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:56.124506 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fb63385b-a1de-4809-b4fe-7e2d948ffa4a tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:56.124927 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fb63385b-a1de-4809-b4fe-7e2d948ffa4a tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:56.436802 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-fb63385b-a1de-4809-b4fe-7e2d948ffa4a tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff420f6aa9044889cdc43c6e2926d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a56c38b564260b994aa1efc3fc829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:11:56.444095 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-fb63385b-a1de-4809-b4fe-7e2d948ffa4a tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/e8141c68-3ada-4780-a71e-a344b9383228" status: 200 len: 1317 microversion: 2.1 time: 0.332637 Nov 16 16:11:56.444690 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 499/1014] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:11:56 2021] GET /compute/v2.1/servers/e8141c68-3ada-4780-a71e-a344b9383228 => generated 1317 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:11:56.504108 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-7f6fa150-f77e-463c-86d9-87d32f097159 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Flavor limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 16:11:56.504535 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-7f6fa150-f77e-463c-86d9-87d32f097159 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Image limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 16:11:56.505013 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-7f6fa150-f77e-463c-86d9-87d32f097159 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Flavor pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 16:11:56.505639 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-7f6fa150-f77e-463c-86d9-87d32f097159 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Image pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 16:11:56.506058 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-7f6fa150-f77e-463c-86d9-87d32f097159 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 16:11:56.516001 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7f6fa150-f77e-463c-86d9-87d32f097159 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:56.516454 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7f6fa150-f77e-463c-86d9-87d32f097159 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:56.517276 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7f6fa150-f77e-463c-86d9-87d32f097159 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:56.517715 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7f6fa150-f77e-463c-86d9-87d32f097159 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:56.538229 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-7f6fa150-f77e-463c-86d9-87d32f097159 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Getting quotas for project df73e9a151d74cbfa33bed295c7c3be3. Resources: {'instances', 'ram', 'cores'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:11:56.543022 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-7f6fa150-f77e-463c-86d9-87d32f097159 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Getting quotas for user 59e4dc563e8e4d80817bb8b3937768b2 and project df73e9a151d74cbfa33bed295c7c3be3. Resources: {'instances', 'ram', 'cores'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:11:56.597163 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-5b7143bf-3fee-4428-a2d9-43ed345bb937 req-a67cec3f-f2fe-4419-b884-75e580313688 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8141c68-3ada-4780-a71e-a344b9383228", "tag": "2a81da43-82b4-4e69-8e1a-fb7d58d2f65b"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:11:56.598938 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:11:56.598938 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Nov 16 16:11:56.603403 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-7f6fa150-f77e-463c-86d9-87d32f097159 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Going to run 1 instances... {{(pid=116084) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 16:11:56.606226 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-7f6fa150-f77e-463c-86d9-87d32f097159 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] [instance: ecfcd452-b06e-4723-b091-7992c79c9e72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='08cec199-85b9-4d22-ab7f-9ebe95903a81',volume_size=None,volume_type=None)] {{(pid=116084) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 16:11:56.613267 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-5b7143bf-3fee-4428-a2d9-43ed345bb937 req-a67cec3f-f2fe-4419-b884-75e580313688 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:56.614368 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-5b7143bf-3fee-4428-a2d9-43ed345bb937 req-a67cec3f-f2fe-4419-b884-75e580313688 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:56.626559 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-5b7143bf-3fee-4428-a2d9-43ed345bb937 req-a67cec3f-f2fe-4419-b884-75e580313688 service nova] Creating event network-changed:2a81da43-82b4-4e69-8e1a-fb7d58d2f65b for instance e8141c68-3ada-4780-a71e-a344b9383228 on hv-cinder-81809 Nov 16 16:11:56.632074 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-5b7143bf-3fee-4428-a2d9-43ed345bb937 req-a67cec3f-f2fe-4419-b884-75e580313688 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039307 Nov 16 16:11:56.635637 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 500/1015] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:11:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:11:56.737581 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-7f6fa150-f77e-463c-86d9-87d32f097159 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.140193 Nov 16 16:11:56.738229 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 516/1016] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 16 16:11:55 2021] POST /compute/v2.1/servers => generated 406 bytes in 1142 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 16:11:56.749276 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-bef54725-57d5-4479-be01-c62733e9ff6d tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:11:56.750133 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-bef54725-57d5-4479-be01-c62733e9ff6d tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] [instance: ecfcd452-b06e-4723-b091-7992c79c9e72] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:56.816140 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-bef54725-57d5-4479-be01-c62733e9ff6d tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e4dc563e8e4d80817bb8b3937768b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df73e9a151d74cbfa33bed295c7c3be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:11:56.822502 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-bef54725-57d5-4479-be01-c62733e9ff6d tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] 10.222.0.46 "GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72" status: 200 len: 1088 microversion: 2.1 time: 0.077800 Nov 16 16:11:56.823064 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 501/1017] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:11:56 2021] GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72 => generated 1088 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:11:57.461154 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-32c92e54-6f40-4023-b550-15f3af9870c1 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:11:57.461802 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-32c92e54-6f40-4023-b550-15f3af9870c1 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: e8141c68-3ada-4780-a71e-a344b9383228] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:57.468326 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-32c92e54-6f40-4023-b550-15f3af9870c1 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:57.468777 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-32c92e54-6f40-4023-b550-15f3af9870c1 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:57.469577 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-32c92e54-6f40-4023-b550-15f3af9870c1 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:57.470014 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-32c92e54-6f40-4023-b550-15f3af9870c1 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:57.819194 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-32c92e54-6f40-4023-b550-15f3af9870c1 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff420f6aa9044889cdc43c6e2926d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a56c38b564260b994aa1efc3fc829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:11:57.829827 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-32c92e54-6f40-4023-b550-15f3af9870c1 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/e8141c68-3ada-4780-a71e-a344b9383228" status: 200 len: 1317 microversion: 2.1 time: 0.372228 Nov 16 16:11:57.830769 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 517/1018] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:11:57 2021] GET /compute/v2.1/servers/e8141c68-3ada-4780-a71e-a344b9383228 => generated 1317 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:11:57.841284 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-d8798e27-7588-418a-8ac1-6666717ecfe8 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:11:57.841908 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-d8798e27-7588-418a-8ac1-6666717ecfe8 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] [instance: ecfcd452-b06e-4723-b091-7992c79c9e72] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:57.850045 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d8798e27-7588-418a-8ac1-6666717ecfe8 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:57.850529 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d8798e27-7588-418a-8ac1-6666717ecfe8 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:57.851326 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d8798e27-7588-418a-8ac1-6666717ecfe8 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:57.851790 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d8798e27-7588-418a-8ac1-6666717ecfe8 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:57.928035 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-d8798e27-7588-418a-8ac1-6666717ecfe8 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e4dc563e8e4d80817bb8b3937768b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df73e9a151d74cbfa33bed295c7c3be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:11:57.939683 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-d8798e27-7588-418a-8ac1-6666717ecfe8 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] 10.222.0.46 "GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72" status: 200 len: 1204 microversion: 2.1 time: 0.102727 Nov 16 16:11:57.942390 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 502/1019] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:11:57 2021] GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72 => generated 1204 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:11:58.848398 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-328838cb-3034-48ad-91ab-ca0f49e986fa tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:11:58.849004 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-328838cb-3034-48ad-91ab-ca0f49e986fa tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: e8141c68-3ada-4780-a71e-a344b9383228] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:58.856048 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-328838cb-3034-48ad-91ab-ca0f49e986fa tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:58.856494 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-328838cb-3034-48ad-91ab-ca0f49e986fa tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:58.857269 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-328838cb-3034-48ad-91ab-ca0f49e986fa tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:58.857707 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-328838cb-3034-48ad-91ab-ca0f49e986fa tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:58.957896 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-f0d0c630-f9b8-4be9-b4b4-1097649f6573 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:11:58.959272 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-f0d0c630-f9b8-4be9-b4b4-1097649f6573 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] [instance: ecfcd452-b06e-4723-b091-7992c79c9e72] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:11:58.968088 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f0d0c630-f9b8-4be9-b4b4-1097649f6573 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:58.968797 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f0d0c630-f9b8-4be9-b4b4-1097649f6573 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:58.969901 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f0d0c630-f9b8-4be9-b4b4-1097649f6573 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:58.971969 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f0d0c630-f9b8-4be9-b4b4-1097649f6573 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:59.040646 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-328838cb-3034-48ad-91ab-ca0f49e986fa tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff420f6aa9044889cdc43c6e2926d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a56c38b564260b994aa1efc3fc829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:11:59.050221 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-328838cb-3034-48ad-91ab-ca0f49e986fa tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/e8141c68-3ada-4780-a71e-a344b9383228" status: 200 len: 1317 microversion: 2.1 time: 0.205684 Nov 16 16:11:59.050806 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 518/1020] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:11:58 2021] GET /compute/v2.1/servers/e8141c68-3ada-4780-a71e-a344b9383228 => generated 1317 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:11:59.139242 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-11a7b4b3-e42f-45ba-9a99-bd158829fde8 req-f7b99860-0e21-4f68-86c4-7cedc72601e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecfcd452-b06e-4723-b091-7992c79c9e72", "tag": "14b10c18-97ea-4e1d-ab84-3f7bc7632b4c"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:11:59.141485 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:11:59.141485 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Nov 16 16:11:59.152523 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-f0d0c630-f9b8-4be9-b4b4-1097649f6573 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e4dc563e8e4d80817bb8b3937768b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df73e9a151d74cbfa33bed295c7c3be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:11:59.159260 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-11a7b4b3-e42f-45ba-9a99-bd158829fde8 req-f7b99860-0e21-4f68-86c4-7cedc72601e4 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:11:59.159817 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-11a7b4b3-e42f-45ba-9a99-bd158829fde8 req-f7b99860-0e21-4f68-86c4-7cedc72601e4 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:11:59.165943 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-f0d0c630-f9b8-4be9-b4b4-1097649f6573 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] 10.222.0.46 "GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72" status: 200 len: 1260 microversion: 2.1 time: 0.211785 Nov 16 16:11:59.166535 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 503/1021] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:11:58 2021] GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72 => generated 1260 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:11:59.181159 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-11a7b4b3-e42f-45ba-9a99-bd158829fde8 req-f7b99860-0e21-4f68-86c4-7cedc72601e4 service nova] Creating event network-changed:14b10c18-97ea-4e1d-ab84-3f7bc7632b4c for instance ecfcd452-b06e-4723-b091-7992c79c9e72 on hv-cinder-81809 Nov 16 16:11:59.187378 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-11a7b4b3-e42f-45ba-9a99-bd158829fde8 req-f7b99860-0e21-4f68-86c4-7cedc72601e4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053083 Nov 16 16:11:59.187955 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 519/1022] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:11:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:12:00.068189 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-d164fd91-611e-4634-9792-384bbfa3e261 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:12:00.068974 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-d164fd91-611e-4634-9792-384bbfa3e261 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: e8141c68-3ada-4780-a71e-a344b9383228] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:12:00.075747 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d164fd91-611e-4634-9792-384bbfa3e261 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:00.076193 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d164fd91-611e-4634-9792-384bbfa3e261 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:00.076972 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d164fd91-611e-4634-9792-384bbfa3e261 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:00.077405 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d164fd91-611e-4634-9792-384bbfa3e261 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:00.185701 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-cc2f2506-3972-4f55-b71b-192ecc9d5571 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:12:00.186390 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-cc2f2506-3972-4f55-b71b-192ecc9d5571 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] [instance: ecfcd452-b06e-4723-b091-7992c79c9e72] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:12:00.192395 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cc2f2506-3972-4f55-b71b-192ecc9d5571 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:00.192839 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cc2f2506-3972-4f55-b71b-192ecc9d5571 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:00.193612 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cc2f2506-3972-4f55-b71b-192ecc9d5571 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:00.194046 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cc2f2506-3972-4f55-b71b-192ecc9d5571 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:00.218111 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-d164fd91-611e-4634-9792-384bbfa3e261 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff420f6aa9044889cdc43c6e2926d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a56c38b564260b994aa1efc3fc829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:12:00.225292 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-d164fd91-611e-4634-9792-384bbfa3e261 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/e8141c68-3ada-4780-a71e-a344b9383228" status: 200 len: 1317 microversion: 2.1 time: 0.160769 Nov 16 16:12:00.225865 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 504/1023] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:12:00 2021] GET /compute/v2.1/servers/e8141c68-3ada-4780-a71e-a344b9383228 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:12:00.325856 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-cc2f2506-3972-4f55-b71b-192ecc9d5571 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e4dc563e8e4d80817bb8b3937768b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df73e9a151d74cbfa33bed295c7c3be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:12:00.333059 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-cc2f2506-3972-4f55-b71b-192ecc9d5571 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] 10.222.0.46 "GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72" status: 200 len: 1260 microversion: 2.1 time: 0.152936 Nov 16 16:12:00.333625 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 520/1024] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:12:00 2021] GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:12:01.241899 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-fe315b65-8987-4360-9201-d98ae2aec252 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:12:01.242433 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-fe315b65-8987-4360-9201-d98ae2aec252 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: e8141c68-3ada-4780-a71e-a344b9383228] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:12:01.249492 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fe315b65-8987-4360-9201-d98ae2aec252 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:01.249934 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fe315b65-8987-4360-9201-d98ae2aec252 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:01.250705 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fe315b65-8987-4360-9201-d98ae2aec252 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:01.251139 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fe315b65-8987-4360-9201-d98ae2aec252 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:01.349758 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6808e929-5fcc-45ac-b644-861037f5ab37 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:12:01.351367 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-6808e929-5fcc-45ac-b644-861037f5ab37 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] [instance: ecfcd452-b06e-4723-b091-7992c79c9e72] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:12:01.358202 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6808e929-5fcc-45ac-b644-861037f5ab37 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:01.358663 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6808e929-5fcc-45ac-b644-861037f5ab37 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:01.359453 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6808e929-5fcc-45ac-b644-861037f5ab37 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:01.360093 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6808e929-5fcc-45ac-b644-861037f5ab37 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:01.388543 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-fe315b65-8987-4360-9201-d98ae2aec252 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff420f6aa9044889cdc43c6e2926d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a56c38b564260b994aa1efc3fc829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:12:01.395982 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-fe315b65-8987-4360-9201-d98ae2aec252 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/e8141c68-3ada-4780-a71e-a344b9383228" status: 200 len: 1317 microversion: 2.1 time: 0.157604 Nov 16 16:12:01.396828 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 505/1025] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:12:01 2021] GET /compute/v2.1/servers/e8141c68-3ada-4780-a71e-a344b9383228 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:12:01.500197 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-6808e929-5fcc-45ac-b644-861037f5ab37 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e4dc563e8e4d80817bb8b3937768b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df73e9a151d74cbfa33bed295c7c3be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:12:01.507376 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-6808e929-5fcc-45ac-b644-861037f5ab37 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] 10.222.0.46 "GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72" status: 200 len: 1260 microversion: 2.1 time: 0.161427 Nov 16 16:12:01.507969 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 521/1026] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:12:01 2021] GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:12:02.413230 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-fb06e216-bc0d-432f-a17b-a098357da190 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:12:02.413823 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-fb06e216-bc0d-432f-a17b-a098357da190 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: e8141c68-3ada-4780-a71e-a344b9383228] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:12:02.421010 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fb06e216-bc0d-432f-a17b-a098357da190 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:02.421455 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fb06e216-bc0d-432f-a17b-a098357da190 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:02.422226 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fb06e216-bc0d-432f-a17b-a098357da190 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:02.422663 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fb06e216-bc0d-432f-a17b-a098357da190 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:02.528834 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-9edd1692-ecb0-4372-a5fe-dd259dae501f tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:12:02.530151 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-9edd1692-ecb0-4372-a5fe-dd259dae501f tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] [instance: ecfcd452-b06e-4723-b091-7992c79c9e72] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:12:02.536565 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9edd1692-ecb0-4372-a5fe-dd259dae501f tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:02.537012 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9edd1692-ecb0-4372-a5fe-dd259dae501f tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:02.537796 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9edd1692-ecb0-4372-a5fe-dd259dae501f tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:02.538233 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9edd1692-ecb0-4372-a5fe-dd259dae501f tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:02.565171 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-fb06e216-bc0d-432f-a17b-a098357da190 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff420f6aa9044889cdc43c6e2926d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a56c38b564260b994aa1efc3fc829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:12:02.572551 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-fb06e216-bc0d-432f-a17b-a098357da190 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/e8141c68-3ada-4780-a71e-a344b9383228" status: 200 len: 1317 microversion: 2.1 time: 0.162852 Nov 16 16:12:02.573360 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 506/1027] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:12:02 2021] GET /compute/v2.1/servers/e8141c68-3ada-4780-a71e-a344b9383228 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:12:02.677129 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-9edd1692-ecb0-4372-a5fe-dd259dae501f tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e4dc563e8e4d80817bb8b3937768b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df73e9a151d74cbfa33bed295c7c3be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:12:02.685029 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-9edd1692-ecb0-4372-a5fe-dd259dae501f tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] 10.222.0.46 "GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72" status: 200 len: 1260 microversion: 2.1 time: 0.160983 Nov 16 16:12:02.685690 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 522/1028] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:12:02 2021] GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:12:03.002585 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-5f3a57b3-d0b6-4cea-92a7-58f287a26814 req-ee09b67f-a411-4c24-a4d6-ca2b8e47c454 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8141c68-3ada-4780-a71e-a344b9383228", "name": "network-vif-plugged", "status": "completed", "tag": "2a81da43-82b4-4e69-8e1a-fb7d58d2f65b"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:12:03.004773 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:12:03.004773 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Nov 16 16:12:03.012860 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-5f3a57b3-d0b6-4cea-92a7-58f287a26814 req-ee09b67f-a411-4c24-a4d6-ca2b8e47c454 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:03.013311 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-5f3a57b3-d0b6-4cea-92a7-58f287a26814 req-ee09b67f-a411-4c24-a4d6-ca2b8e47c454 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:03.028041 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-5f3a57b3-d0b6-4cea-92a7-58f287a26814 req-ee09b67f-a411-4c24-a4d6-ca2b8e47c454 service nova] Creating event network-vif-plugged:2a81da43-82b4-4e69-8e1a-fb7d58d2f65b for instance e8141c68-3ada-4780-a71e-a344b9383228 on hv-cinder-81809 Nov 16 16:12:03.032961 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-5f3a57b3-d0b6-4cea-92a7-58f287a26814 req-ee09b67f-a411-4c24-a4d6-ca2b8e47c454 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034407 Nov 16 16:12:03.033859 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 507/1029] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:12:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:12:03.590104 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-acbecab2-4ec4-4c7f-b976-66f1f7705d17 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:12:03.590724 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-acbecab2-4ec4-4c7f-b976-66f1f7705d17 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: e8141c68-3ada-4780-a71e-a344b9383228] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:12:03.597532 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-acbecab2-4ec4-4c7f-b976-66f1f7705d17 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:03.597981 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-acbecab2-4ec4-4c7f-b976-66f1f7705d17 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:03.598759 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-acbecab2-4ec4-4c7f-b976-66f1f7705d17 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:03.599198 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-acbecab2-4ec4-4c7f-b976-66f1f7705d17 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:03.702054 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-7f35c203-49ba-4ac5-b240-3ec58378f0ea tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:12:03.703530 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-7f35c203-49ba-4ac5-b240-3ec58378f0ea tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] [instance: ecfcd452-b06e-4723-b091-7992c79c9e72] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:12:03.710759 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7f35c203-49ba-4ac5-b240-3ec58378f0ea tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:03.711208 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7f35c203-49ba-4ac5-b240-3ec58378f0ea tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:03.712028 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7f35c203-49ba-4ac5-b240-3ec58378f0ea tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:03.712465 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7f35c203-49ba-4ac5-b240-3ec58378f0ea tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:03.737514 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-acbecab2-4ec4-4c7f-b976-66f1f7705d17 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff420f6aa9044889cdc43c6e2926d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a56c38b564260b994aa1efc3fc829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:12:03.745427 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-acbecab2-4ec4-4c7f-b976-66f1f7705d17 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/e8141c68-3ada-4780-a71e-a344b9383228" status: 200 len: 1317 microversion: 2.1 time: 0.158734 Nov 16 16:12:03.746386 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 523/1030] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:12:03 2021] GET /compute/v2.1/servers/e8141c68-3ada-4780-a71e-a344b9383228 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:12:03.863959 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-7f35c203-49ba-4ac5-b240-3ec58378f0ea tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e4dc563e8e4d80817bb8b3937768b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df73e9a151d74cbfa33bed295c7c3be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:12:03.872229 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-7f35c203-49ba-4ac5-b240-3ec58378f0ea tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] 10.222.0.46 "GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72" status: 200 len: 1260 microversion: 2.1 time: 0.174330 Nov 16 16:12:03.872771 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 508/1031] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:12:03 2021] GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72 => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:12:04.761858 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-31eaa6da-df2b-4520-817f-997285bab3d0 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:12:04.762460 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-31eaa6da-df2b-4520-817f-997285bab3d0 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: e8141c68-3ada-4780-a71e-a344b9383228] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:12:04.768697 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-31eaa6da-df2b-4520-817f-997285bab3d0 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:04.769138 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-31eaa6da-df2b-4520-817f-997285bab3d0 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:04.769903 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-31eaa6da-df2b-4520-817f-997285bab3d0 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:04.770334 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-31eaa6da-df2b-4520-817f-997285bab3d0 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:04.889529 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-e0aca905-2d9e-4152-94dc-4eef673b6a8c tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:12:04.890256 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-e0aca905-2d9e-4152-94dc-4eef673b6a8c tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] [instance: ecfcd452-b06e-4723-b091-7992c79c9e72] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:12:04.896387 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e0aca905-2d9e-4152-94dc-4eef673b6a8c tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:04.896829 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e0aca905-2d9e-4152-94dc-4eef673b6a8c tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:04.897596 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e0aca905-2d9e-4152-94dc-4eef673b6a8c tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:04.898021 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e0aca905-2d9e-4152-94dc-4eef673b6a8c tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:04.905452 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-31eaa6da-df2b-4520-817f-997285bab3d0 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff420f6aa9044889cdc43c6e2926d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a56c38b564260b994aa1efc3fc829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:12:04.912644 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-31eaa6da-df2b-4520-817f-997285bab3d0 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/e8141c68-3ada-4780-a71e-a344b9383228" status: 200 len: 1508 microversion: 2.1 time: 0.154653 Nov 16 16:12:04.913222 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 524/1032] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:12:04 2021] GET /compute/v2.1/servers/e8141c68-3ada-4780-a71e-a344b9383228 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:12:05.035410 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-e0aca905-2d9e-4152-94dc-4eef673b6a8c tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e4dc563e8e4d80817bb8b3937768b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df73e9a151d74cbfa33bed295c7c3be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:12:05.043597 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-e0aca905-2d9e-4152-94dc-4eef673b6a8c tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] 10.222.0.46 "GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72" status: 200 len: 1260 microversion: 2.1 time: 0.158137 Nov 16 16:12:05.044174 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 509/1033] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:12:04 2021] GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:12:06.062327 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-4ce31be5-f159-48b5-814b-02b0933f050d tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:12:06.062946 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-4ce31be5-f159-48b5-814b-02b0933f050d tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] [instance: ecfcd452-b06e-4723-b091-7992c79c9e72] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:12:06.069257 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4ce31be5-f159-48b5-814b-02b0933f050d tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:06.069704 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4ce31be5-f159-48b5-814b-02b0933f050d tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:06.070483 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4ce31be5-f159-48b5-814b-02b0933f050d tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:06.070919 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4ce31be5-f159-48b5-814b-02b0933f050d tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:06.211363 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-4ce31be5-f159-48b5-814b-02b0933f050d tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e4dc563e8e4d80817bb8b3937768b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df73e9a151d74cbfa33bed295c7c3be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:12:06.219192 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-4ce31be5-f159-48b5-814b-02b0933f050d tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] 10.222.0.46 "GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72" status: 200 len: 1260 microversion: 2.1 time: 0.161194 Nov 16 16:12:06.219785 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 525/1034] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:12:06 2021] GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:12:06.222644 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-2c33cbe2-2c0a-4727-b106-a41a4b2742f1 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d4692ada-f769-4c50-bc55-da0d88bb286f"}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:12:06.223801 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-2c33cbe2-2c0a-4727-b106-a41a4b2742f1 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: e8141c68-3ada-4780-a71e-a344b9383228] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:12:06.230895 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2c33cbe2-2c0a-4727-b106-a41a4b2742f1 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:06.231351 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2c33cbe2-2c0a-4727-b106-a41a4b2742f1 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:06.232161 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2c33cbe2-2c0a-4727-b106-a41a4b2742f1 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:06.232594 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2c33cbe2-2c0a-4727-b106-a41a4b2742f1 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:06.458456 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-2c33cbe2-2c0a-4727-b106-a41a4b2742f1 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "POST /compute/v2.1/servers/e8141c68-3ada-4780-a71e-a344b9383228/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.239378 Nov 16 16:12:06.462257 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 510/1035] 10.222.0.46 () {60 vars in 1322 bytes} [Tue Nov 16 16:12:06 2021] POST /compute/v2.1/servers/e8141c68-3ada-4780-a71e-a344b9383228/os-volume_attachments => generated 194 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:12:07.235824 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f3bdc8a0-93f8-4f13-8cc1-d3f352e3034e tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:12:07.236438 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f3bdc8a0-93f8-4f13-8cc1-d3f352e3034e tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] [instance: ecfcd452-b06e-4723-b091-7992c79c9e72] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:12:07.242736 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f3bdc8a0-93f8-4f13-8cc1-d3f352e3034e tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:07.243191 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f3bdc8a0-93f8-4f13-8cc1-d3f352e3034e tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:07.243985 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f3bdc8a0-93f8-4f13-8cc1-d3f352e3034e tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:07.244414 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f3bdc8a0-93f8-4f13-8cc1-d3f352e3034e tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:07.381063 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f3bdc8a0-93f8-4f13-8cc1-d3f352e3034e tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e4dc563e8e4d80817bb8b3937768b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df73e9a151d74cbfa33bed295c7c3be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:12:07.389168 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f3bdc8a0-93f8-4f13-8cc1-d3f352e3034e tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] 10.222.0.46 "GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72" status: 200 len: 1260 microversion: 2.1 time: 0.157299 Nov 16 16:12:07.389768 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 526/1036] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:12:07 2021] GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:12:08.407173 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-7ce4f9a5-43a4-46d2-baa7-c75bcf7ac046 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:12:08.407929 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-7ce4f9a5-43a4-46d2-baa7-c75bcf7ac046 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] [instance: ecfcd452-b06e-4723-b091-7992c79c9e72] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:12:08.414486 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7ce4f9a5-43a4-46d2-baa7-c75bcf7ac046 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:08.414932 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7ce4f9a5-43a4-46d2-baa7-c75bcf7ac046 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:08.415739 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7ce4f9a5-43a4-46d2-baa7-c75bcf7ac046 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:08.416180 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7ce4f9a5-43a4-46d2-baa7-c75bcf7ac046 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:08.553378 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-7ce4f9a5-43a4-46d2-baa7-c75bcf7ac046 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e4dc563e8e4d80817bb8b3937768b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df73e9a151d74cbfa33bed295c7c3be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:12:08.560853 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-7ce4f9a5-43a4-46d2-baa7-c75bcf7ac046 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] 10.222.0.46 "GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72" status: 200 len: 1260 microversion: 2.1 time: 0.157701 Nov 16 16:12:08.561424 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 511/1037] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:12:08 2021] GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:12:09.010901 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-8b21bc62-dc17-45cd-94d1-2ac20bcfd6c0 req-a765d080-9101-4079-9e3c-f84e46f1a532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecfcd452-b06e-4723-b091-7992c79c9e72", "name": "network-vif-plugged", "status": "completed", "tag": "14b10c18-97ea-4e1d-ab84-3f7bc7632b4c"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:12:09.013384 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:12:09.013384 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Nov 16 16:12:09.022262 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-8b21bc62-dc17-45cd-94d1-2ac20bcfd6c0 req-a765d080-9101-4079-9e3c-f84e46f1a532 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:09.023449 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-8b21bc62-dc17-45cd-94d1-2ac20bcfd6c0 req-a765d080-9101-4079-9e3c-f84e46f1a532 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:09.035658 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-8b21bc62-dc17-45cd-94d1-2ac20bcfd6c0 req-a765d080-9101-4079-9e3c-f84e46f1a532 service nova] Creating event network-vif-plugged:14b10c18-97ea-4e1d-ab84-3f7bc7632b4c for instance ecfcd452-b06e-4723-b091-7992c79c9e72 on hv-cinder-81809 Nov 16 16:12:09.040448 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-8b21bc62-dc17-45cd-94d1-2ac20bcfd6c0 req-a765d080-9101-4079-9e3c-f84e46f1a532 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033408 Nov 16 16:12:09.041043 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 527/1038] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:12:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:12:09.577898 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-c7cdc09c-e5a8-4caf-ab8a-4e07775d554c tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:12:09.578455 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-c7cdc09c-e5a8-4caf-ab8a-4e07775d554c tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] [instance: ecfcd452-b06e-4723-b091-7992c79c9e72] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:12:09.585055 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c7cdc09c-e5a8-4caf-ab8a-4e07775d554c tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:09.585502 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c7cdc09c-e5a8-4caf-ab8a-4e07775d554c tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:09.586299 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c7cdc09c-e5a8-4caf-ab8a-4e07775d554c tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:09.586739 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c7cdc09c-e5a8-4caf-ab8a-4e07775d554c tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:09.723121 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-c7cdc09c-e5a8-4caf-ab8a-4e07775d554c tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e4dc563e8e4d80817bb8b3937768b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df73e9a151d74cbfa33bed295c7c3be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:12:09.730657 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-c7cdc09c-e5a8-4caf-ab8a-4e07775d554c tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] 10.222.0.46 "GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72" status: 200 len: 1260 microversion: 2.1 time: 0.157070 Nov 16 16:12:09.731488 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 512/1039] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:12:09 2021] GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:12:10.747722 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-506428c5-6fe8-4454-a90f-37c1477ea811 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:12:10.748430 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-506428c5-6fe8-4454-a90f-37c1477ea811 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] [instance: ecfcd452-b06e-4723-b091-7992c79c9e72] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:12:10.754898 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-506428c5-6fe8-4454-a90f-37c1477ea811 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:10.755351 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-506428c5-6fe8-4454-a90f-37c1477ea811 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:10.756160 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-506428c5-6fe8-4454-a90f-37c1477ea811 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:10.756601 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-506428c5-6fe8-4454-a90f-37c1477ea811 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:10.891163 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-506428c5-6fe8-4454-a90f-37c1477ea811 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e4dc563e8e4d80817bb8b3937768b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df73e9a151d74cbfa33bed295c7c3be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:12:10.898552 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-506428c5-6fe8-4454-a90f-37c1477ea811 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] 10.222.0.46 "GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72" status: 200 len: 1445 microversion: 2.1 time: 0.154896 Nov 16 16:12:10.899125 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 528/1040] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:12:10 2021] GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72 => generated 1445 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:12:10.914899 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-36cc1c42-7e09-48d5-9cf1-22957889241d tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:12:10.915528 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-36cc1c42-7e09-48d5-9cf1-22957889241d tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] [instance: ecfcd452-b06e-4723-b091-7992c79c9e72] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:12:10.922414 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-36cc1c42-7e09-48d5-9cf1-22957889241d tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:10.922886 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-36cc1c42-7e09-48d5-9cf1-22957889241d tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:10.923687 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-36cc1c42-7e09-48d5-9cf1-22957889241d tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:10.924118 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-36cc1c42-7e09-48d5-9cf1-22957889241d tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:11.053451 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-36cc1c42-7e09-48d5-9cf1-22957889241d tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e4dc563e8e4d80817bb8b3937768b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df73e9a151d74cbfa33bed295c7c3be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:12:11.060920 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-36cc1c42-7e09-48d5-9cf1-22957889241d tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] 10.222.0.46 "GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72" status: 200 len: 1445 microversion: 2.1 time: 0.149699 Nov 16 16:12:11.061481 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 513/1041] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:12:10 2021] GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72 => generated 1445 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:12:12.740675 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-a18bee19-9606-41e1-b0b7-bc8c548ed9f3 req-e3c70d58-d477-4463-950c-5acb0e3a380b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecfcd452-b06e-4723-b091-7992c79c9e72", "tag": "14b10c18-97ea-4e1d-ab84-3f7bc7632b4c"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:12:12.742181 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:12:12.742181 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Nov 16 16:12:12.750040 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-a18bee19-9606-41e1-b0b7-bc8c548ed9f3 req-e3c70d58-d477-4463-950c-5acb0e3a380b service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:12.750485 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-a18bee19-9606-41e1-b0b7-bc8c548ed9f3 req-e3c70d58-d477-4463-950c-5acb0e3a380b service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:12.761063 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-a18bee19-9606-41e1-b0b7-bc8c548ed9f3 req-e3c70d58-d477-4463-950c-5acb0e3a380b service nova] Creating event network-changed:14b10c18-97ea-4e1d-ab84-3f7bc7632b4c for instance ecfcd452-b06e-4723-b091-7992c79c9e72 on hv-cinder-81809 Nov 16 16:12:12.766085 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-a18bee19-9606-41e1-b0b7-bc8c548ed9f3 req-e3c70d58-d477-4463-950c-5acb0e3a380b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029270 Nov 16 16:12:12.766670 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 529/1042] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:12:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:12:14.023840 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-fbed4a27-0b9f-44ef-8573-23278c0aedbe tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:12:14.024327 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-fbed4a27-0b9f-44ef-8573-23278c0aedbe tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: e8141c68-3ada-4780-a71e-a344b9383228] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:12:14.031035 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fbed4a27-0b9f-44ef-8573-23278c0aedbe tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:14.031509 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fbed4a27-0b9f-44ef-8573-23278c0aedbe tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:14.032271 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fbed4a27-0b9f-44ef-8573-23278c0aedbe tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:14.032696 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fbed4a27-0b9f-44ef-8573-23278c0aedbe tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:14.108417 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.objects.instance [None req-fbed4a27-0b9f-44ef-8573-23278c0aedbe tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lazy-loading 'services' on Instance uuid e8141c68-3ada-4780-a71e-a344b9383228 {{(pid=116085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:12:14.177260 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-fbed4a27-0b9f-44ef-8573-23278c0aedbe tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e8141c68-3ada-4780-a71e-a344b9383228/os-volume_attachments/d4692ada-f769-4c50-bc55-da0d88bb286f" status: 202 len: 0 microversion: 2.1 time: 0.156789 Nov 16 16:12:14.177845 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 514/1043] 10.222.0.46 () {58 vars in 1415 bytes} [Tue Nov 16 16:12:14 2021] DELETE /compute/v2.1/servers/e8141c68-3ada-4780-a71e-a344b9383228/os-volume_attachments/d4692ada-f769-4c50-bc55-da0d88bb286f => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:12:14.187534 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-9ee92fad-54ce-4e1e-8e67-ad71c3797d4b tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:12:14.188537 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-9ee92fad-54ce-4e1e-8e67-ad71c3797d4b tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: e8141c68-3ada-4780-a71e-a344b9383228] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:12:14.197386 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9ee92fad-54ce-4e1e-8e67-ad71c3797d4b tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:14.197952 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9ee92fad-54ce-4e1e-8e67-ad71c3797d4b tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:14.198861 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9ee92fad-54ce-4e1e-8e67-ad71c3797d4b tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:14.199551 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9ee92fad-54ce-4e1e-8e67-ad71c3797d4b tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:14.233270 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-9ee92fad-54ce-4e1e-8e67-ad71c3797d4b tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/e8141c68-3ada-4780-a71e-a344b9383228/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050854 Nov 16 16:12:14.233857 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 530/1044] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 16 16:12:14 2021] GET /compute/v2.1/servers/e8141c68-3ada-4780-a71e-a344b9383228/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:12:15.247741 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-eddafebb-3de0-46a1-a7fe-4a63c2833c06 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:12:15.249532 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-eddafebb-3de0-46a1-a7fe-4a63c2833c06 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: e8141c68-3ada-4780-a71e-a344b9383228] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:12:15.255673 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-eddafebb-3de0-46a1-a7fe-4a63c2833c06 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:15.256119 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-eddafebb-3de0-46a1-a7fe-4a63c2833c06 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:15.256924 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-eddafebb-3de0-46a1-a7fe-4a63c2833c06 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:15.257361 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-eddafebb-3de0-46a1-a7fe-4a63c2833c06 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:15.286737 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-eddafebb-3de0-46a1-a7fe-4a63c2833c06 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/e8141c68-3ada-4780-a71e-a344b9383228/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044737 Nov 16 16:12:15.287278 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 515/1045] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 16 16:12:15 2021] GET /compute/v2.1/servers/e8141c68-3ada-4780-a71e-a344b9383228/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 16:12:16.469183 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f0db3fae-241b-4810-9ba7-5923ba88975c tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:12:16.469680 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f0db3fae-241b-4810-9ba7-5923ba88975c tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: e8141c68-3ada-4780-a71e-a344b9383228] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:12:16.475663 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f0db3fae-241b-4810-9ba7-5923ba88975c tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:16.476113 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f0db3fae-241b-4810-9ba7-5923ba88975c tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:16.476896 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f0db3fae-241b-4810-9ba7-5923ba88975c tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:16.477334 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f0db3fae-241b-4810-9ba7-5923ba88975c tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:16.503326 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f0db3fae-241b-4810-9ba7-5923ba88975c tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: e8141c68-3ada-4780-a71e-a344b9383228] Going to try to terminate instance {{(pid=116084) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 16:12:16.582528 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f0db3fae-241b-4810-9ba7-5923ba88975c tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e8141c68-3ada-4780-a71e-a344b9383228" status: 204 len: 0 microversion: 2.1 time: 0.118102 Nov 16 16:12:16.583117 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 531/1046] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 16 16:12:16 2021] DELETE /compute/v2.1/servers/e8141c68-3ada-4780-a71e-a344b9383228 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 16:12:16.591313 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-8ad47b24-a7a3-4a0c-a5c5-56ab94558fdb tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:12:16.593107 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-8ad47b24-a7a3-4a0c-a5c5-56ab94558fdb tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: e8141c68-3ada-4780-a71e-a344b9383228] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:12:16.599068 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8ad47b24-a7a3-4a0c-a5c5-56ab94558fdb tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:16.599548 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8ad47b24-a7a3-4a0c-a5c5-56ab94558fdb tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:16.600332 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8ad47b24-a7a3-4a0c-a5c5-56ab94558fdb tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:16.600764 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8ad47b24-a7a3-4a0c-a5c5-56ab94558fdb tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:16.731148 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-8ad47b24-a7a3-4a0c-a5c5-56ab94558fdb tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff420f6aa9044889cdc43c6e2926d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a56c38b564260b994aa1efc3fc829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:12:16.738644 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-8ad47b24-a7a3-4a0c-a5c5-56ab94558fdb tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/e8141c68-3ada-4780-a71e-a344b9383228" status: 200 len: 1514 microversion: 2.1 time: 0.151302 Nov 16 16:12:16.739216 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 516/1047] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:12:16 2021] GET /compute/v2.1/servers/e8141c68-3ada-4780-a71e-a344b9383228 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:12:17.757211 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-13086d68-1bc8-496d-93c8-8d0a26f0b05d tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:12:17.757922 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-13086d68-1bc8-496d-93c8-8d0a26f0b05d tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: e8141c68-3ada-4780-a71e-a344b9383228] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:12:17.765441 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-13086d68-1bc8-496d-93c8-8d0a26f0b05d tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:17.765913 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-13086d68-1bc8-496d-93c8-8d0a26f0b05d tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:17.766703 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-13086d68-1bc8-496d-93c8-8d0a26f0b05d tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:17.767127 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-13086d68-1bc8-496d-93c8-8d0a26f0b05d tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:17.905305 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-13086d68-1bc8-496d-93c8-8d0a26f0b05d tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff420f6aa9044889cdc43c6e2926d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a56c38b564260b994aa1efc3fc829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:12:17.913555 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-13086d68-1bc8-496d-93c8-8d0a26f0b05d tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/e8141c68-3ada-4780-a71e-a344b9383228" status: 200 len: 1514 microversion: 2.1 time: 0.161074 Nov 16 16:12:17.914129 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 532/1048] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:12:17 2021] GET /compute/v2.1/servers/e8141c68-3ada-4780-a71e-a344b9383228 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:12:18.930461 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-ab3073b0-7a7d-49e4-889a-78780ea91d76 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:12:18.931325 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-ab3073b0-7a7d-49e4-889a-78780ea91d76 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: e8141c68-3ada-4780-a71e-a344b9383228] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:12:18.938506 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ab3073b0-7a7d-49e4-889a-78780ea91d76 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:18.939181 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ab3073b0-7a7d-49e4-889a-78780ea91d76 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:18.940040 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ab3073b0-7a7d-49e4-889a-78780ea91d76 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:18.940530 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ab3073b0-7a7d-49e4-889a-78780ea91d76 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:18.971524 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-d6183413-fd59-4575-90b9-b5f297d2c85f req-7183e0d7-2fb8-4be3-be94-9c3c30127c36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8141c68-3ada-4780-a71e-a344b9383228", "name": "network-vif-deleted", "tag": "2a81da43-82b4-4e69-8e1a-fb7d58d2f65b"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:12:18.974999 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:12:18.974999 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Nov 16 16:12:18.994579 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-d6183413-fd59-4575-90b9-b5f297d2c85f req-7183e0d7-2fb8-4be3-be94-9c3c30127c36 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:18.997394 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-d6183413-fd59-4575-90b9-b5f297d2c85f req-7183e0d7-2fb8-4be3-be94-9c3c30127c36 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:19.012964 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-d6183413-fd59-4575-90b9-b5f297d2c85f req-7183e0d7-2fb8-4be3-be94-9c3c30127c36 service nova] Creating event network-vif-deleted:2a81da43-82b4-4e69-8e1a-fb7d58d2f65b for instance e8141c68-3ada-4780-a71e-a344b9383228 on hv-cinder-81809 Nov 16 16:12:19.019023 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-d6183413-fd59-4575-90b9-b5f297d2c85f req-7183e0d7-2fb8-4be3-be94-9c3c30127c36 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053165 Nov 16 16:12:19.019186 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-ab3073b0-7a7d-49e4-889a-78780ea91d76 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff420f6aa9044889cdc43c6e2926d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a56c38b564260b994aa1efc3fc829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:12:19.020024 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 533/1049] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:12:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:12:19.032319 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-ab3073b0-7a7d-49e4-889a-78780ea91d76 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/e8141c68-3ada-4780-a71e-a344b9383228" status: 200 len: 1472 microversion: 2.1 time: 0.105636 Nov 16 16:12:19.033469 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 517/1050] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:12:18 2021] GET /compute/v2.1/servers/e8141c68-3ada-4780-a71e-a344b9383228 => generated 1472 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:12:20.049971 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-5d5f8944-ea9d-47a6-84af-a39257c3e88f tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:12:20.050673 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-5d5f8944-ea9d-47a6-84af-a39257c3e88f tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: e8141c68-3ada-4780-a71e-a344b9383228] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:12:20.057229 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5d5f8944-ea9d-47a6-84af-a39257c3e88f tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:20.057678 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5d5f8944-ea9d-47a6-84af-a39257c3e88f tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:20.058489 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5d5f8944-ea9d-47a6-84af-a39257c3e88f tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:20.058926 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5d5f8944-ea9d-47a6-84af-a39257c3e88f tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:20.071582 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-5d5f8944-ea9d-47a6-84af-a39257c3e88f tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] HTTP exception thrown: Instance e8141c68-3ada-4780-a71e-a344b9383228 could not be found. Nov 16 16:12:20.072170 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-5d5f8944-ea9d-47a6-84af-a39257c3e88f tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Returning 404 to user: Instance e8141c68-3ada-4780-a71e-a344b9383228 could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:12:20.072983 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-5d5f8944-ea9d-47a6-84af-a39257c3e88f tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/e8141c68-3ada-4780-a71e-a344b9383228" status: 404 len: 111 microversion: 2.1 time: 0.027084 Nov 16 16:12:20.073510 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 534/1051] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:12:20 2021] GET /compute/v2.1/servers/e8141c68-3ada-4780-a71e-a344b9383228 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 16 16:12:21.198960 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-8d4e7d0d-c84b-4a32-ad62-a2c457987c62 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:12:21.199480 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-8d4e7d0d-c84b-4a32-ad62-a2c457987c62 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 5251b895-35a2-4a27-ae13-9ef1995cbc9e] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:12:21.206557 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8d4e7d0d-c84b-4a32-ad62-a2c457987c62 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:21.207006 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8d4e7d0d-c84b-4a32-ad62-a2c457987c62 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:21.207998 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8d4e7d0d-c84b-4a32-ad62-a2c457987c62 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:21.208243 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8d4e7d0d-c84b-4a32-ad62-a2c457987c62 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:21.231952 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-8d4e7d0d-c84b-4a32-ad62-a2c457987c62 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 5251b895-35a2-4a27-ae13-9ef1995cbc9e] Going to try to terminate instance {{(pid=116085) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 16:12:21.304484 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-8d4e7d0d-c84b-4a32-ad62-a2c457987c62 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5251b895-35a2-4a27-ae13-9ef1995cbc9e" status: 204 len: 0 microversion: 2.1 time: 0.108858 Nov 16 16:12:21.305085 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 518/1052] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 16 16:12:21 2021] DELETE /compute/v2.1/servers/5251b895-35a2-4a27-ae13-9ef1995cbc9e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 16:12:21.313586 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6edf43fc-3fe8-42e8-85a0-ed4a74c729b8 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:12:21.314207 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-6edf43fc-3fe8-42e8-85a0-ed4a74c729b8 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 5251b895-35a2-4a27-ae13-9ef1995cbc9e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:12:21.320423 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6edf43fc-3fe8-42e8-85a0-ed4a74c729b8 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:21.320871 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6edf43fc-3fe8-42e8-85a0-ed4a74c729b8 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:21.321654 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6edf43fc-3fe8-42e8-85a0-ed4a74c729b8 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:21.322086 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6edf43fc-3fe8-42e8-85a0-ed4a74c729b8 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:21.451986 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-6edf43fc-3fe8-42e8-85a0-ed4a74c729b8 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff420f6aa9044889cdc43c6e2926d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a56c38b564260b994aa1efc3fc829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:12:21.459203 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-6edf43fc-3fe8-42e8-85a0-ed4a74c729b8 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/5251b895-35a2-4a27-ae13-9ef1995cbc9e" status: 200 len: 1513 microversion: 2.1 time: 0.149873 Nov 16 16:12:21.459815 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 535/1053] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:12:21 2021] GET /compute/v2.1/servers/5251b895-35a2-4a27-ae13-9ef1995cbc9e => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:12:22.476665 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-bfa0c4c4-8b2c-4495-a33c-f07f14ca0b0b tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:12:22.477367 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-bfa0c4c4-8b2c-4495-a33c-f07f14ca0b0b tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 5251b895-35a2-4a27-ae13-9ef1995cbc9e] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:12:22.483995 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bfa0c4c4-8b2c-4495-a33c-f07f14ca0b0b tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:22.484443 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bfa0c4c4-8b2c-4495-a33c-f07f14ca0b0b tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:22.485224 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bfa0c4c4-8b2c-4495-a33c-f07f14ca0b0b tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:22.485662 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bfa0c4c4-8b2c-4495-a33c-f07f14ca0b0b tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:22.615783 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-bfa0c4c4-8b2c-4495-a33c-f07f14ca0b0b tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff420f6aa9044889cdc43c6e2926d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a56c38b564260b994aa1efc3fc829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:12:22.623811 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-bfa0c4c4-8b2c-4495-a33c-f07f14ca0b0b tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/5251b895-35a2-4a27-ae13-9ef1995cbc9e" status: 200 len: 1513 microversion: 2.1 time: 0.150328 Nov 16 16:12:22.624252 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 519/1054] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:12:22 2021] GET /compute/v2.1/servers/5251b895-35a2-4a27-ae13-9ef1995cbc9e => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:12:23.544010 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-c8427ac0-cbee-4a85-b0db-d5dd3d11949c req-7676cc13-3831-4633-934a-ed7c71b88b8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5251b895-35a2-4a27-ae13-9ef1995cbc9e", "name": "network-vif-deleted", "tag": "8eeb4aa5-da20-4dc1-9493-f6a58cbdc337"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:12:23.547567 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:12:23.547567 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Nov 16 16:12:23.555841 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-c8427ac0-cbee-4a85-b0db-d5dd3d11949c req-7676cc13-3831-4633-934a-ed7c71b88b8b service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:23.556282 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-c8427ac0-cbee-4a85-b0db-d5dd3d11949c req-7676cc13-3831-4633-934a-ed7c71b88b8b service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:23.569115 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-c8427ac0-cbee-4a85-b0db-d5dd3d11949c req-7676cc13-3831-4633-934a-ed7c71b88b8b service nova] Creating event network-vif-deleted:8eeb4aa5-da20-4dc1-9493-f6a58cbdc337 for instance 5251b895-35a2-4a27-ae13-9ef1995cbc9e on hv-cinder-81809 Nov 16 16:12:23.574515 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-c8427ac0-cbee-4a85-b0db-d5dd3d11949c req-7676cc13-3831-4633-934a-ed7c71b88b8b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033833 Nov 16 16:12:23.575287 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 536/1055] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:12:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:12:23.641792 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-f435f1b4-dfc7-440f-97d9-32a7f11a3be0 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:12:23.642699 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-f435f1b4-dfc7-440f-97d9-32a7f11a3be0 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 5251b895-35a2-4a27-ae13-9ef1995cbc9e] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:12:23.649582 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f435f1b4-dfc7-440f-97d9-32a7f11a3be0 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:23.650378 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f435f1b4-dfc7-440f-97d9-32a7f11a3be0 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:23.651554 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f435f1b4-dfc7-440f-97d9-32a7f11a3be0 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:23.652059 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f435f1b4-dfc7-440f-97d9-32a7f11a3be0 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:23.685161 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f435f1b4-dfc7-440f-97d9-32a7f11a3be0 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:23.686190 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f435f1b4-dfc7-440f-97d9-32a7f11a3be0 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:23.686646 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.objects.instance [None req-f435f1b4-dfc7-440f-97d9-32a7f11a3be0 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lazy-loading 'fault' on Instance uuid 5251b895-35a2-4a27-ae13-9ef1995cbc9e {{(pid=116085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:12:23.731206 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-f435f1b4-dfc7-440f-97d9-32a7f11a3be0 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff420f6aa9044889cdc43c6e2926d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a56c38b564260b994aa1efc3fc829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:12:23.739090 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-f435f1b4-dfc7-440f-97d9-32a7f11a3be0 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/5251b895-35a2-4a27-ae13-9ef1995cbc9e" status: 200 len: 1307 microversion: 2.1 time: 0.102473 Nov 16 16:12:23.739684 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 520/1056] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:12:23 2021] GET /compute/v2.1/servers/5251b895-35a2-4a27-ae13-9ef1995cbc9e => generated 1307 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:12:24.756866 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d93be42a-3da1-451e-af5d-7ee929f120ce tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:12:24.757567 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d93be42a-3da1-451e-af5d-7ee929f120ce tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 5251b895-35a2-4a27-ae13-9ef1995cbc9e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:12:24.764238 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d93be42a-3da1-451e-af5d-7ee929f120ce tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:24.764685 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d93be42a-3da1-451e-af5d-7ee929f120ce tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:24.765491 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d93be42a-3da1-451e-af5d-7ee929f120ce tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:24.765927 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d93be42a-3da1-451e-af5d-7ee929f120ce tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:24.779149 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-d93be42a-3da1-451e-af5d-7ee929f120ce tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] HTTP exception thrown: Instance 5251b895-35a2-4a27-ae13-9ef1995cbc9e could not be found. Nov 16 16:12:24.779789 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d93be42a-3da1-451e-af5d-7ee929f120ce tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Returning 404 to user: Instance 5251b895-35a2-4a27-ae13-9ef1995cbc9e could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:12:24.780609 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d93be42a-3da1-451e-af5d-7ee929f120ce tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/5251b895-35a2-4a27-ae13-9ef1995cbc9e" status: 404 len: 111 microversion: 2.1 time: 0.027813 Nov 16 16:12:24.781140 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 537/1057] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:12:24 2021] GET /compute/v2.1/servers/5251b895-35a2-4a27-ae13-9ef1995cbc9e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 16 16:12:24.788827 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-d052e365-f21e-401f-af59-00a054b3b894 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:12:24.789456 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-d052e365-f21e-401f-af59-00a054b3b894 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 0556b1c3-b8f8-41ca-85b8-2852285a49f9] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:12:24.796634 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d052e365-f21e-401f-af59-00a054b3b894 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:24.797086 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d052e365-f21e-401f-af59-00a054b3b894 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:24.797868 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d052e365-f21e-401f-af59-00a054b3b894 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:24.798345 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d052e365-f21e-401f-af59-00a054b3b894 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:24.822849 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-d052e365-f21e-401f-af59-00a054b3b894 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 0556b1c3-b8f8-41ca-85b8-2852285a49f9] Going to try to terminate instance {{(pid=116085) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 16:12:24.896609 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-d052e365-f21e-401f-af59-00a054b3b894 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0556b1c3-b8f8-41ca-85b8-2852285a49f9" status: 204 len: 0 microversion: 2.1 time: 0.111114 Nov 16 16:12:24.897200 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 521/1058] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 16 16:12:24 2021] DELETE /compute/v2.1/servers/0556b1c3-b8f8-41ca-85b8-2852285a49f9 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 16:12:24.907197 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0c10e2f2-b114-4c6a-95b8-502f20df6313 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:12:24.907831 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0c10e2f2-b114-4c6a-95b8-502f20df6313 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 0556b1c3-b8f8-41ca-85b8-2852285a49f9] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:12:24.913960 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0c10e2f2-b114-4c6a-95b8-502f20df6313 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:24.914407 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0c10e2f2-b114-4c6a-95b8-502f20df6313 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:24.915179 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0c10e2f2-b114-4c6a-95b8-502f20df6313 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:24.915683 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0c10e2f2-b114-4c6a-95b8-502f20df6313 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:25.055895 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0c10e2f2-b114-4c6a-95b8-502f20df6313 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff420f6aa9044889cdc43c6e2926d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a56c38b564260b994aa1efc3fc829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:12:25.063367 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0c10e2f2-b114-4c6a-95b8-502f20df6313 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/0556b1c3-b8f8-41ca-85b8-2852285a49f9" status: 200 len: 1515 microversion: 2.1 time: 0.161524 Nov 16 16:12:25.063958 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 538/1059] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:12:24 2021] GET /compute/v2.1/servers/0556b1c3-b8f8-41ca-85b8-2852285a49f9 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:12:26.081021 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-35db4d17-64d0-44a3-9557-7644b88ff8a5 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:12:26.081739 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-35db4d17-64d0-44a3-9557-7644b88ff8a5 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 0556b1c3-b8f8-41ca-85b8-2852285a49f9] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:12:26.088106 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-35db4d17-64d0-44a3-9557-7644b88ff8a5 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:26.088551 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-35db4d17-64d0-44a3-9557-7644b88ff8a5 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:26.089321 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-35db4d17-64d0-44a3-9557-7644b88ff8a5 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:26.089756 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-35db4d17-64d0-44a3-9557-7644b88ff8a5 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:26.221341 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-35db4d17-64d0-44a3-9557-7644b88ff8a5 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff420f6aa9044889cdc43c6e2926d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a56c38b564260b994aa1efc3fc829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:12:26.228685 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-35db4d17-64d0-44a3-9557-7644b88ff8a5 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/0556b1c3-b8f8-41ca-85b8-2852285a49f9" status: 200 len: 1515 microversion: 2.1 time: 0.151778 Nov 16 16:12:26.229254 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 522/1060] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:12:26 2021] GET /compute/v2.1/servers/0556b1c3-b8f8-41ca-85b8-2852285a49f9 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:12:26.867071 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-3eb8c53c-885c-46bd-a36c-e18dc9100653 req-18b9c7a9-77ec-4f7c-bffb-66c7cc1fb575 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0556b1c3-b8f8-41ca-85b8-2852285a49f9", "name": "network-vif-deleted", "tag": "c7e4fe7f-71cc-49de-b03e-045a57243e92"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:12:26.868758 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:12:26.868758 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Nov 16 16:12:26.878281 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-3eb8c53c-885c-46bd-a36c-e18dc9100653 req-18b9c7a9-77ec-4f7c-bffb-66c7cc1fb575 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:26.878727 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-3eb8c53c-885c-46bd-a36c-e18dc9100653 req-18b9c7a9-77ec-4f7c-bffb-66c7cc1fb575 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:26.892148 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-3eb8c53c-885c-46bd-a36c-e18dc9100653 req-18b9c7a9-77ec-4f7c-bffb-66c7cc1fb575 service nova] Creating event network-vif-deleted:c7e4fe7f-71cc-49de-b03e-045a57243e92 for instance 0556b1c3-b8f8-41ca-85b8-2852285a49f9 on hv-cinder-81809 Nov 16 16:12:26.897396 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-3eb8c53c-885c-46bd-a36c-e18dc9100653 req-18b9c7a9-77ec-4f7c-bffb-66c7cc1fb575 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033964 Nov 16 16:12:26.898547 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 539/1061] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:12:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:12:27.246472 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-67dbe56b-4429-4686-aac1-f2f3a1c5ef02 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:12:27.247026 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-67dbe56b-4429-4686-aac1-f2f3a1c5ef02 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 0556b1c3-b8f8-41ca-85b8-2852285a49f9] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:12:27.253930 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-67dbe56b-4429-4686-aac1-f2f3a1c5ef02 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:27.254629 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-67dbe56b-4429-4686-aac1-f2f3a1c5ef02 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:27.255412 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-67dbe56b-4429-4686-aac1-f2f3a1c5ef02 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:27.256082 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-67dbe56b-4429-4686-aac1-f2f3a1c5ef02 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:27.288774 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-67dbe56b-4429-4686-aac1-f2f3a1c5ef02 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:27.289219 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-67dbe56b-4429-4686-aac1-f2f3a1c5ef02 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:27.289671 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.objects.instance [None req-67dbe56b-4429-4686-aac1-f2f3a1c5ef02 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lazy-loading 'fault' on Instance uuid 0556b1c3-b8f8-41ca-85b8-2852285a49f9 {{(pid=116085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:12:27.335809 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-67dbe56b-4429-4686-aac1-f2f3a1c5ef02 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff420f6aa9044889cdc43c6e2926d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a56c38b564260b994aa1efc3fc829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:12:27.344044 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-67dbe56b-4429-4686-aac1-f2f3a1c5ef02 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/0556b1c3-b8f8-41ca-85b8-2852285a49f9" status: 200 len: 1308 microversion: 2.1 time: 0.102051 Nov 16 16:12:27.344607 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 523/1062] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:12:27 2021] GET /compute/v2.1/servers/0556b1c3-b8f8-41ca-85b8-2852285a49f9 => generated 1308 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:12:28.362751 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b7f41e21-4b83-470d-b514-7b16ee214674 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:12:28.363451 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b7f41e21-4b83-470d-b514-7b16ee214674 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 0556b1c3-b8f8-41ca-85b8-2852285a49f9] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:12:28.369571 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b7f41e21-4b83-470d-b514-7b16ee214674 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:28.370025 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b7f41e21-4b83-470d-b514-7b16ee214674 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:28.370801 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b7f41e21-4b83-470d-b514-7b16ee214674 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:28.371244 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b7f41e21-4b83-470d-b514-7b16ee214674 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:28.384601 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-b7f41e21-4b83-470d-b514-7b16ee214674 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] HTTP exception thrown: Instance 0556b1c3-b8f8-41ca-85b8-2852285a49f9 could not be found. Nov 16 16:12:28.385182 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b7f41e21-4b83-470d-b514-7b16ee214674 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Returning 404 to user: Instance 0556b1c3-b8f8-41ca-85b8-2852285a49f9 could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:12:28.385999 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b7f41e21-4b83-470d-b514-7b16ee214674 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/0556b1c3-b8f8-41ca-85b8-2852285a49f9" status: 404 len: 111 microversion: 2.1 time: 0.028212 Nov 16 16:12:28.386528 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 540/1063] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:12:28 2021] GET /compute/v2.1/servers/0556b1c3-b8f8-41ca-85b8-2852285a49f9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:12:29.512980 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-4322618d-ae81-43ca-a1fd-7e813e78c1a7 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:12:29.513455 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-4322618d-ae81-43ca-a1fd-7e813e78c1a7 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 77b84f3a-873d-4d5b-88c1-655bc337610e] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:12:29.520221 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4322618d-ae81-43ca-a1fd-7e813e78c1a7 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:29.520657 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4322618d-ae81-43ca-a1fd-7e813e78c1a7 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:29.521422 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4322618d-ae81-43ca-a1fd-7e813e78c1a7 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:29.521849 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4322618d-ae81-43ca-a1fd-7e813e78c1a7 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:29.547182 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-4322618d-ae81-43ca-a1fd-7e813e78c1a7 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 77b84f3a-873d-4d5b-88c1-655bc337610e] Going to try to terminate instance {{(pid=116085) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 16:12:29.626835 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-4322618d-ae81-43ca-a1fd-7e813e78c1a7 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "DELETE /compute/v2.1/servers/77b84f3a-873d-4d5b-88c1-655bc337610e" status: 204 len: 0 microversion: 2.1 time: 0.116909 Nov 16 16:12:29.627456 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 524/1064] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 16 16:12:29 2021] DELETE /compute/v2.1/servers/77b84f3a-873d-4d5b-88c1-655bc337610e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 16:12:29.635948 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b827035b-a564-4013-89b5-5e7f9a5f3bfc tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:12:29.636563 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b827035b-a564-4013-89b5-5e7f9a5f3bfc tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 77b84f3a-873d-4d5b-88c1-655bc337610e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:12:29.642889 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b827035b-a564-4013-89b5-5e7f9a5f3bfc tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:29.643448 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b827035b-a564-4013-89b5-5e7f9a5f3bfc tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:29.644258 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b827035b-a564-4013-89b5-5e7f9a5f3bfc tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:29.644697 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b827035b-a564-4013-89b5-5e7f9a5f3bfc tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:29.776843 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b827035b-a564-4013-89b5-5e7f9a5f3bfc tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff420f6aa9044889cdc43c6e2926d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a56c38b564260b994aa1efc3fc829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:12:29.784820 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b827035b-a564-4013-89b5-5e7f9a5f3bfc tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/77b84f3a-873d-4d5b-88c1-655bc337610e" status: 200 len: 1514 microversion: 2.1 time: 0.153151 Nov 16 16:12:29.785392 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 541/1065] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:12:29 2021] GET /compute/v2.1/servers/77b84f3a-873d-4d5b-88c1-655bc337610e => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:12:30.802994 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-a87c018f-81cd-48ac-89a0-2b3d1016cb5b tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:12:30.803765 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-a87c018f-81cd-48ac-89a0-2b3d1016cb5b tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 77b84f3a-873d-4d5b-88c1-655bc337610e] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:12:30.809954 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a87c018f-81cd-48ac-89a0-2b3d1016cb5b tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:30.810394 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a87c018f-81cd-48ac-89a0-2b3d1016cb5b tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:30.812118 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a87c018f-81cd-48ac-89a0-2b3d1016cb5b tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:30.812553 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a87c018f-81cd-48ac-89a0-2b3d1016cb5b tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:30.948264 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-a87c018f-81cd-48ac-89a0-2b3d1016cb5b tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff420f6aa9044889cdc43c6e2926d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a56c38b564260b994aa1efc3fc829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:12:30.955646 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-a87c018f-81cd-48ac-89a0-2b3d1016cb5b tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/77b84f3a-873d-4d5b-88c1-655bc337610e" status: 200 len: 1514 microversion: 2.1 time: 0.156609 Nov 16 16:12:30.956206 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 525/1066] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:12:30 2021] GET /compute/v2.1/servers/77b84f3a-873d-4d5b-88c1-655bc337610e => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:12:31.716490 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-dfe904c8-bd2d-444a-a467-daa42be8976d req-f8b2be13-43ea-4d4f-9ff4-062c6fc99f70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77b84f3a-873d-4d5b-88c1-655bc337610e", "name": "network-vif-deleted", "tag": "35db0ace-0705-4914-a3c5-dc0165afe4c6"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:12:31.718783 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:12:31.718783 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Nov 16 16:12:31.726982 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-dfe904c8-bd2d-444a-a467-daa42be8976d req-f8b2be13-43ea-4d4f-9ff4-062c6fc99f70 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:31.727422 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-dfe904c8-bd2d-444a-a467-daa42be8976d req-f8b2be13-43ea-4d4f-9ff4-062c6fc99f70 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:31.740542 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-dfe904c8-bd2d-444a-a467-daa42be8976d req-f8b2be13-43ea-4d4f-9ff4-062c6fc99f70 service nova] Creating event network-vif-deleted:35db0ace-0705-4914-a3c5-dc0165afe4c6 for instance 77b84f3a-873d-4d5b-88c1-655bc337610e on hv-cinder-81809 Nov 16 16:12:31.745425 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-dfe904c8-bd2d-444a-a467-daa42be8976d req-f8b2be13-43ea-4d4f-9ff4-062c6fc99f70 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032471 Nov 16 16:12:31.746021 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 542/1067] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:12:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:12:31.973244 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-f3d90134-29a7-41a9-b6e8-5953df309d28 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:12:31.973794 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-f3d90134-29a7-41a9-b6e8-5953df309d28 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 77b84f3a-873d-4d5b-88c1-655bc337610e] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:12:31.979938 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f3d90134-29a7-41a9-b6e8-5953df309d28 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:31.980374 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f3d90134-29a7-41a9-b6e8-5953df309d28 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:31.981132 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f3d90134-29a7-41a9-b6e8-5953df309d28 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:31.981558 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f3d90134-29a7-41a9-b6e8-5953df309d28 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:32.011457 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f3d90134-29a7-41a9-b6e8-5953df309d28 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:32.011924 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f3d90134-29a7-41a9-b6e8-5953df309d28 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:32.012361 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.objects.instance [None req-f3d90134-29a7-41a9-b6e8-5953df309d28 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lazy-loading 'fault' on Instance uuid 77b84f3a-873d-4d5b-88c1-655bc337610e {{(pid=116085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:12:32.055410 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-f3d90134-29a7-41a9-b6e8-5953df309d28 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff420f6aa9044889cdc43c6e2926d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a56c38b564260b994aa1efc3fc829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:12:32.062974 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-f3d90134-29a7-41a9-b6e8-5953df309d28 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/77b84f3a-873d-4d5b-88c1-655bc337610e" status: 200 len: 1307 microversion: 2.1 time: 0.093410 Nov 16 16:12:32.063803 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 526/1068] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:12:31 2021] GET /compute/v2.1/servers/77b84f3a-873d-4d5b-88c1-655bc337610e => generated 1307 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:12:33.081141 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-54ef5b6a-8845-4308-8500-0f4d4342a843 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:12:33.081862 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-54ef5b6a-8845-4308-8500-0f4d4342a843 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] [instance: 77b84f3a-873d-4d5b-88c1-655bc337610e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:12:33.087978 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-54ef5b6a-8845-4308-8500-0f4d4342a843 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:33.088445 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-54ef5b6a-8845-4308-8500-0f4d4342a843 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:33.089225 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-54ef5b6a-8845-4308-8500-0f4d4342a843 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:12:33.089666 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-54ef5b6a-8845-4308-8500-0f4d4342a843 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:12:33.103171 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-54ef5b6a-8845-4308-8500-0f4d4342a843 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] HTTP exception thrown: Instance 77b84f3a-873d-4d5b-88c1-655bc337610e could not be found. Nov 16 16:12:33.103777 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-54ef5b6a-8845-4308-8500-0f4d4342a843 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] Returning 404 to user: Instance 77b84f3a-873d-4d5b-88c1-655bc337610e could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:12:33.104598 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-54ef5b6a-8845-4308-8500-0f4d4342a843 tempest-AttachVolumeNegativeTest-26735042 tempest-AttachVolumeNegativeTest-26735042-project] 10.222.0.46 "GET /compute/v2.1/servers/77b84f3a-873d-4d5b-88c1-655bc337610e" status: 404 len: 111 microversion: 2.1 time: 0.028380 Nov 16 16:12:33.105123 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 543/1069] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:12:33 2021] GET /compute/v2.1/servers/77b84f3a-873d-4d5b-88c1-655bc337610e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 16 16:13:07.260132 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-a2975198-291e-4c89-b0f8-7150fae71781 req-8700c413-be91-4d4b-a74c-9c6ab0dcdbf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dcc72f3-865c-48e2-9ae9-7d91eef84f35", "tag": "10f5fb1e-fddd-4de2-b420-4ed412992643"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:13:07.261649 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:13:07.261649 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Nov 16 16:13:07.266955 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-815d7a7e-8f80-4609-866e-a8391edb3e83 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:13:07.267456 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-815d7a7e-8f80-4609-866e-a8391edb3e83 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: 6dcc72f3-865c-48e2-9ae9-7d91eef84f35] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:13:07.275165 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-815d7a7e-8f80-4609-866e-a8391edb3e83 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:13:07.275396 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-a2975198-291e-4c89-b0f8-7150fae71781 req-8700c413-be91-4d4b-a74c-9c6ab0dcdbf6 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:13:07.275652 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-a2975198-291e-4c89-b0f8-7150fae71781 req-8700c413-be91-4d4b-a74c-9c6ab0dcdbf6 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:13:07.275794 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-815d7a7e-8f80-4609-866e-a8391edb3e83 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:13:07.276442 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-815d7a7e-8f80-4609-866e-a8391edb3e83 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:13:07.276879 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-815d7a7e-8f80-4609-866e-a8391edb3e83 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:13:07.286773 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-a2975198-291e-4c89-b0f8-7150fae71781 req-8700c413-be91-4d4b-a74c-9c6ab0dcdbf6 service nova] Creating event network-changed:10f5fb1e-fddd-4de2-b420-4ed412992643 for instance 6dcc72f3-865c-48e2-9ae9-7d91eef84f35 on hv-cinder-81809 Nov 16 16:13:07.291867 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-a2975198-291e-4c89-b0f8-7150fae71781 req-8700c413-be91-4d4b-a74c-9c6ab0dcdbf6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035306 Nov 16 16:13:07.292703 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 544/1070] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:13:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:13:07.302977 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-815d7a7e-8f80-4609-866e-a8391edb3e83 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: 6dcc72f3-865c-48e2-9ae9-7d91eef84f35] Going to try to terminate instance {{(pid=116085) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 16:13:07.390863 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-815d7a7e-8f80-4609-866e-a8391edb3e83 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6dcc72f3-865c-48e2-9ae9-7d91eef84f35" status: 204 len: 0 microversion: 2.1 time: 0.137491 Nov 16 16:13:07.392796 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 527/1071] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 16 16:13:07 2021] DELETE /compute/v2.1/servers/6dcc72f3-865c-48e2-9ae9-7d91eef84f35 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 16:13:07.401214 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ba6894a4-ae3b-46f6-9f68-c7e68dc2687f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:13:07.401914 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ba6894a4-ae3b-46f6-9f68-c7e68dc2687f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: 6dcc72f3-865c-48e2-9ae9-7d91eef84f35] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:13:07.408927 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ba6894a4-ae3b-46f6-9f68-c7e68dc2687f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:13:07.409849 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ba6894a4-ae3b-46f6-9f68-c7e68dc2687f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:13:07.411052 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ba6894a4-ae3b-46f6-9f68-c7e68dc2687f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:13:07.411718 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ba6894a4-ae3b-46f6-9f68-c7e68dc2687f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:13:07.567991 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ba6894a4-ae3b-46f6-9f68-c7e68dc2687f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:13:07.577672 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ba6894a4-ae3b-46f6-9f68-c7e68dc2687f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/6dcc72f3-865c-48e2-9ae9-7d91eef84f35" status: 200 len: 1576 microversion: 2.1 time: 0.180352 Nov 16 16:13:07.579111 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 545/1072] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:13:07 2021] GET /compute/v2.1/servers/6dcc72f3-865c-48e2-9ae9-7d91eef84f35 => generated 1576 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:13:08.597391 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-d029c916-8a53-4280-b363-cd07ba34daf2 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:13:08.598088 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-d029c916-8a53-4280-b363-cd07ba34daf2 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: 6dcc72f3-865c-48e2-9ae9-7d91eef84f35] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:13:08.604410 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d029c916-8a53-4280-b363-cd07ba34daf2 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:13:08.604855 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d029c916-8a53-4280-b363-cd07ba34daf2 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:13:08.605628 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d029c916-8a53-4280-b363-cd07ba34daf2 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:13:08.606062 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d029c916-8a53-4280-b363-cd07ba34daf2 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:13:08.740556 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-d029c916-8a53-4280-b363-cd07ba34daf2 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:13:08.747947 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-d029c916-8a53-4280-b363-cd07ba34daf2 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/6dcc72f3-865c-48e2-9ae9-7d91eef84f35" status: 200 len: 1458 microversion: 2.1 time: 0.154610 Nov 16 16:13:08.748517 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 528/1073] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:13:08 2021] GET /compute/v2.1/servers/6dcc72f3-865c-48e2-9ae9-7d91eef84f35 => generated 1458 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:13:09.622414 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-ed40806f-caea-480f-b9ed-6f00cc507263 req-ba0d2dcc-3265-4eda-945d-818227a99785 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dcc72f3-865c-48e2-9ae9-7d91eef84f35", "name": "network-vif-deleted", "tag": "10f5fb1e-fddd-4de2-b420-4ed412992643"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:13:09.624437 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:13:09.624437 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Nov 16 16:13:09.635149 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-ed40806f-caea-480f-b9ed-6f00cc507263 req-ba0d2dcc-3265-4eda-945d-818227a99785 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:13:09.635692 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-ed40806f-caea-480f-b9ed-6f00cc507263 req-ba0d2dcc-3265-4eda-945d-818227a99785 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:13:09.650603 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-ed40806f-caea-480f-b9ed-6f00cc507263 req-ba0d2dcc-3265-4eda-945d-818227a99785 service nova] Creating event network-vif-deleted:10f5fb1e-fddd-4de2-b420-4ed412992643 for instance 6dcc72f3-865c-48e2-9ae9-7d91eef84f35 on hv-cinder-81809 Nov 16 16:13:09.656422 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-ed40806f-caea-480f-b9ed-6f00cc507263 req-ba0d2dcc-3265-4eda-945d-818227a99785 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037682 Nov 16 16:13:09.657019 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 546/1074] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:13:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:13:09.765689 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-e1edb00f-c1fe-45b9-80da-469f42992422 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:13:09.766293 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-e1edb00f-c1fe-45b9-80da-469f42992422 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: 6dcc72f3-865c-48e2-9ae9-7d91eef84f35] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:13:09.772738 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e1edb00f-c1fe-45b9-80da-469f42992422 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:13:09.773183 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e1edb00f-c1fe-45b9-80da-469f42992422 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:13:09.773984 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e1edb00f-c1fe-45b9-80da-469f42992422 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:13:09.774679 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e1edb00f-c1fe-45b9-80da-469f42992422 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:13:09.835074 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-e1edb00f-c1fe-45b9-80da-469f42992422 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:13:09.842549 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-e1edb00f-c1fe-45b9-80da-469f42992422 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/6dcc72f3-865c-48e2-9ae9-7d91eef84f35" status: 200 len: 1225 microversion: 2.1 time: 0.080511 Nov 16 16:13:09.843179 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 529/1075] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:13:09 2021] GET /compute/v2.1/servers/6dcc72f3-865c-48e2-9ae9-7d91eef84f35 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:13:10.861925 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-555b755d-2f6f-49ed-80b8-e2a959d963ce tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:13:10.864150 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-555b755d-2f6f-49ed-80b8-e2a959d963ce tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: 6dcc72f3-865c-48e2-9ae9-7d91eef84f35] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:13:10.873745 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-555b755d-2f6f-49ed-80b8-e2a959d963ce tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:13:10.874301 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-555b755d-2f6f-49ed-80b8-e2a959d963ce tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:13:10.875113 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-555b755d-2f6f-49ed-80b8-e2a959d963ce tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:13:10.875579 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-555b755d-2f6f-49ed-80b8-e2a959d963ce tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:13:10.893483 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-555b755d-2f6f-49ed-80b8-e2a959d963ce tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] HTTP exception thrown: Instance 6dcc72f3-865c-48e2-9ae9-7d91eef84f35 could not be found. Nov 16 16:13:10.894071 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-555b755d-2f6f-49ed-80b8-e2a959d963ce tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Returning 404 to user: Instance 6dcc72f3-865c-48e2-9ae9-7d91eef84f35 could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:13:10.894890 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-555b755d-2f6f-49ed-80b8-e2a959d963ce tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/6dcc72f3-865c-48e2-9ae9-7d91eef84f35" status: 404 len: 111 microversion: 2.1 time: 0.037548 Nov 16 16:13:10.895434 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 547/1076] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:13:10 2021] GET /compute/v2.1/servers/6dcc72f3-865c-48e2-9ae9-7d91eef84f35 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:13:13.977740 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-4ad04157-49a2-4690-8e77-54a546f4cd38 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:13:13.978265 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-4ad04157-49a2-4690-8e77-54a546f4cd38 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: 9bc90f3f-4249-42b0-b344-cb67784082db] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:13:13.981486 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-bbf789ca-7296-4031-94e2-2d2c4bd20e88 req-3b6a1022-4ceb-498d-8a14-a0ad77fe8579 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bc90f3f-4249-42b0-b344-cb67784082db", "tag": "56ca6ce4-eb92-4ff7-876a-3215434b21af"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:13:13.985429 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:13:13.985429 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Nov 16 16:13:13.990170 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4ad04157-49a2-4690-8e77-54a546f4cd38 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:13:13.990624 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4ad04157-49a2-4690-8e77-54a546f4cd38 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:13:13.991402 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4ad04157-49a2-4690-8e77-54a546f4cd38 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:13:14.002007 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-bbf789ca-7296-4031-94e2-2d2c4bd20e88 req-3b6a1022-4ceb-498d-8a14-a0ad77fe8579 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:13:14.004279 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4ad04157-49a2-4690-8e77-54a546f4cd38 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:13:14.009833 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-bbf789ca-7296-4031-94e2-2d2c4bd20e88 req-3b6a1022-4ceb-498d-8a14-a0ad77fe8579 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:13:14.026075 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-bbf789ca-7296-4031-94e2-2d2c4bd20e88 req-3b6a1022-4ceb-498d-8a14-a0ad77fe8579 service nova] Creating event network-changed:56ca6ce4-eb92-4ff7-876a-3215434b21af for instance 9bc90f3f-4249-42b0-b344-cb67784082db on hv-cinder-81809 Nov 16 16:13:14.031013 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-bbf789ca-7296-4031-94e2-2d2c4bd20e88 req-3b6a1022-4ceb-498d-8a14-a0ad77fe8579 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054346 Nov 16 16:13:14.031821 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 548/1077] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:13:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:13:14.042000 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-4ad04157-49a2-4690-8e77-54a546f4cd38 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: 9bc90f3f-4249-42b0-b344-cb67784082db] Going to try to terminate instance {{(pid=116085) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 16:13:14.126523 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-4ad04157-49a2-4690-8e77-54a546f4cd38 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9bc90f3f-4249-42b0-b344-cb67784082db" status: 204 len: 0 microversion: 2.1 time: 0.152249 Nov 16 16:13:14.128261 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 530/1078] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 16 16:13:13 2021] DELETE /compute/v2.1/servers/9bc90f3f-4249-42b0-b344-cb67784082db => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 16:13:14.136618 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-66441bd0-be2e-4435-8bff-abaf2311d05f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:13:14.137667 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-66441bd0-be2e-4435-8bff-abaf2311d05f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: 9bc90f3f-4249-42b0-b344-cb67784082db] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:13:14.144594 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-66441bd0-be2e-4435-8bff-abaf2311d05f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:13:14.145030 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-66441bd0-be2e-4435-8bff-abaf2311d05f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:13:14.145806 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-66441bd0-be2e-4435-8bff-abaf2311d05f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:13:14.146234 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-66441bd0-be2e-4435-8bff-abaf2311d05f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:13:14.302917 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-66441bd0-be2e-4435-8bff-abaf2311d05f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:13:14.312680 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-66441bd0-be2e-4435-8bff-abaf2311d05f tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/9bc90f3f-4249-42b0-b344-cb67784082db" status: 200 len: 1578 microversion: 2.1 time: 0.180159 Nov 16 16:13:14.313299 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 549/1079] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:13:14 2021] GET /compute/v2.1/servers/9bc90f3f-4249-42b0-b344-cb67784082db => generated 1578 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:13:15.330042 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-d69b340b-1952-4fb9-b14f-115dc05fbe66 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:13:15.330739 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-d69b340b-1952-4fb9-b14f-115dc05fbe66 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: 9bc90f3f-4249-42b0-b344-cb67784082db] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:13:15.337976 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d69b340b-1952-4fb9-b14f-115dc05fbe66 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:13:15.338420 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d69b340b-1952-4fb9-b14f-115dc05fbe66 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:13:15.339200 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d69b340b-1952-4fb9-b14f-115dc05fbe66 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:13:15.339674 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d69b340b-1952-4fb9-b14f-115dc05fbe66 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:13:15.477720 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-d69b340b-1952-4fb9-b14f-115dc05fbe66 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:13:15.485364 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-d69b340b-1952-4fb9-b14f-115dc05fbe66 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/9bc90f3f-4249-42b0-b344-cb67784082db" status: 200 len: 1459 microversion: 2.1 time: 0.159321 Nov 16 16:13:15.485936 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 531/1080] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:13:15 2021] GET /compute/v2.1/servers/9bc90f3f-4249-42b0-b344-cb67784082db => generated 1459 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:13:16.186558 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-349f4769-5536-44a3-a0e4-50f63357eeff req-abcbac48-3b4a-4d0e-8a20-fc7835c566a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bc90f3f-4249-42b0-b344-cb67784082db", "name": "network-vif-deleted", "tag": "56ca6ce4-eb92-4ff7-876a-3215434b21af"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:13:16.188677 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:13:16.188677 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Nov 16 16:13:16.196199 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-349f4769-5536-44a3-a0e4-50f63357eeff req-abcbac48-3b4a-4d0e-8a20-fc7835c566a8 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:13:16.196648 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-349f4769-5536-44a3-a0e4-50f63357eeff req-abcbac48-3b4a-4d0e-8a20-fc7835c566a8 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:13:16.208954 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-349f4769-5536-44a3-a0e4-50f63357eeff req-abcbac48-3b4a-4d0e-8a20-fc7835c566a8 service nova] Creating event network-vif-deleted:56ca6ce4-eb92-4ff7-876a-3215434b21af for instance 9bc90f3f-4249-42b0-b344-cb67784082db on hv-cinder-81809 Nov 16 16:13:16.215053 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-349f4769-5536-44a3-a0e4-50f63357eeff req-abcbac48-3b4a-4d0e-8a20-fc7835c566a8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031901 Nov 16 16:13:16.215672 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 550/1081] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:13:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:13:16.509533 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-445eed19-4b3f-486a-b02f-cf403abbb4ee tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:13:16.510558 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-445eed19-4b3f-486a-b02f-cf403abbb4ee tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: 9bc90f3f-4249-42b0-b344-cb67784082db] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:13:16.522036 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-445eed19-4b3f-486a-b02f-cf403abbb4ee tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:13:16.522864 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-445eed19-4b3f-486a-b02f-cf403abbb4ee tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:13:16.523704 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-445eed19-4b3f-486a-b02f-cf403abbb4ee tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:13:16.524134 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-445eed19-4b3f-486a-b02f-cf403abbb4ee tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:13:16.571715 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-445eed19-4b3f-486a-b02f-cf403abbb4ee tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:13:16.572154 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-445eed19-4b3f-486a-b02f-cf403abbb4ee tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:13:16.572603 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.objects.instance [None req-445eed19-4b3f-486a-b02f-cf403abbb4ee tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lazy-loading 'fault' on Instance uuid 9bc90f3f-4249-42b0-b344-cb67784082db {{(pid=116085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:13:16.613405 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-445eed19-4b3f-486a-b02f-cf403abbb4ee tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd363b1ed870843a6ba751e0d1ea0bd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bdf7025cb744f088b95cb0bba5169b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:13:16.621423 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-445eed19-4b3f-486a-b02f-cf403abbb4ee tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/9bc90f3f-4249-42b0-b344-cb67784082db" status: 200 len: 1231 microversion: 2.1 time: 0.119787 Nov 16 16:13:16.622003 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 532/1082] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:13:16 2021] GET /compute/v2.1/servers/9bc90f3f-4249-42b0-b344-cb67784082db => generated 1231 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:13:17.638848 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c9a6944f-340d-40a6-85dc-d6faabe56fbf tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:13:17.639711 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c9a6944f-340d-40a6-85dc-d6faabe56fbf tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: 9bc90f3f-4249-42b0-b344-cb67784082db] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:13:17.646188 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c9a6944f-340d-40a6-85dc-d6faabe56fbf tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:13:17.646631 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c9a6944f-340d-40a6-85dc-d6faabe56fbf tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:13:17.648598 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c9a6944f-340d-40a6-85dc-d6faabe56fbf tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:13:17.649033 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c9a6944f-340d-40a6-85dc-d6faabe56fbf tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:13:17.661911 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-c9a6944f-340d-40a6-85dc-d6faabe56fbf tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] HTTP exception thrown: Instance 9bc90f3f-4249-42b0-b344-cb67784082db could not be found. Nov 16 16:13:17.663215 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c9a6944f-340d-40a6-85dc-d6faabe56fbf tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Returning 404 to user: Instance 9bc90f3f-4249-42b0-b344-cb67784082db could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:13:17.664359 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c9a6944f-340d-40a6-85dc-d6faabe56fbf tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/9bc90f3f-4249-42b0-b344-cb67784082db" status: 404 len: 111 microversion: 2.1 time: 0.029485 Nov 16 16:13:17.664884 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 551/1083] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:13:17 2021] GET /compute/v2.1/servers/9bc90f3f-4249-42b0-b344-cb67784082db => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:13:18.118528 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-0ea85432-1938-452a-ba0c-6aef5dd896d2 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:13:18.119043 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-0ea85432-1938-452a-ba0c-6aef5dd896d2 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: db94bd78-8ff3-4784-84bd-e09796f6633a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:13:18.125276 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0ea85432-1938-452a-ba0c-6aef5dd896d2 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:13:18.125723 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0ea85432-1938-452a-ba0c-6aef5dd896d2 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:13:18.126499 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0ea85432-1938-452a-ba0c-6aef5dd896d2 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:13:18.126936 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0ea85432-1938-452a-ba0c-6aef5dd896d2 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:13:18.140293 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.wsgi [None req-0ea85432-1938-452a-ba0c-6aef5dd896d2 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] HTTP exception thrown: Instance db94bd78-8ff3-4784-84bd-e09796f6633a could not be found. Nov 16 16:13:18.140909 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-0ea85432-1938-452a-ba0c-6aef5dd896d2 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Returning 404 to user: Instance db94bd78-8ff3-4784-84bd-e09796f6633a could not be found. {{(pid=116085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:13:18.141752 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-0ea85432-1938-452a-ba0c-6aef5dd896d2 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "DELETE /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a" status: 404 len: 111 microversion: 2.1 time: 0.027175 Nov 16 16:13:18.142287 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 533/1084] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 16 16:13:18 2021] DELETE /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:13:18.151306 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-06c9d5d5-ccc4-4b71-8312-1e68f7258937 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:13:18.151983 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-06c9d5d5-ccc4-4b71-8312-1e68f7258937 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] [instance: db94bd78-8ff3-4784-84bd-e09796f6633a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:13:18.157807 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-06c9d5d5-ccc4-4b71-8312-1e68f7258937 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:13:18.158258 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-06c9d5d5-ccc4-4b71-8312-1e68f7258937 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:13:18.159043 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-06c9d5d5-ccc4-4b71-8312-1e68f7258937 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:13:18.159495 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-06c9d5d5-ccc4-4b71-8312-1e68f7258937 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:13:18.172379 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-06c9d5d5-ccc4-4b71-8312-1e68f7258937 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] HTTP exception thrown: Instance db94bd78-8ff3-4784-84bd-e09796f6633a could not be found. Nov 16 16:13:18.172968 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-06c9d5d5-ccc4-4b71-8312-1e68f7258937 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Returning 404 to user: Instance db94bd78-8ff3-4784-84bd-e09796f6633a could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:13:18.173784 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-06c9d5d5-ccc4-4b71-8312-1e68f7258937 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a" status: 404 len: 111 microversion: 2.1 time: 0.027376 Nov 16 16:13:18.174320 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 552/1085] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:13:18 2021] GET /compute/v2.1/servers/db94bd78-8ff3-4784-84bd-e09796f6633a => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:13:19.470113 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-3d76ad2b-63d0-4bd0-81d6-e47d5a0bfa94 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] Calling method '.version_select at 0x7f113c187040>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:13:19.494372 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-3d76ad2b-63d0-4bd0-81d6-e47d5a0bfa94 tempest-TestVolumeBootPattern-1690683984 tempest-TestVolumeBootPattern-1690683984-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1166381435" status: 202 len: 0 microversion: 2.1 time: 0.027991 Nov 16 16:13:19.495017 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 534/1086] 10.222.0.46 () {58 vars in 1262 bytes} [Tue Nov 16 16:13:19 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1166381435 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:14:02.136421 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 16 16:14:02.137120 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: Tue Nov 16 16:14:02 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 16 16:14:04.976965 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 16 16:14:04.978556 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: Tue Nov 16 16:14:04 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 16 16:14:12.807205 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-32d636b7-aabc-4e19-b62f-f6a940e0cbc5 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:14:12.807929 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-32d636b7-aabc-4e19-b62f-f6a940e0cbc5 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] [instance: ecfcd452-b06e-4723-b091-7992c79c9e72] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:14:12.813728 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-32d636b7-aabc-4e19-b62f-f6a940e0cbc5 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:12.814176 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-32d636b7-aabc-4e19-b62f-f6a940e0cbc5 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:12.814951 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-32d636b7-aabc-4e19-b62f-f6a940e0cbc5 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:12.815390 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-32d636b7-aabc-4e19-b62f-f6a940e0cbc5 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:12.837678 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.objects.instance [None req-32d636b7-aabc-4e19-b62f-f6a940e0cbc5 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lazy-loading 'flavor' on Instance uuid ecfcd452-b06e-4723-b091-7992c79c9e72 {{(pid=116084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:14:12.904614 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-32d636b7-aabc-4e19-b62f-f6a940e0cbc5 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] 10.222.0.46 "POST /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72/action" status: 202 len: 0 microversion: 2.1 time: 0.101697 Nov 16 16:14:12.905205 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 553/1087] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:14:12 2021] POST /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:14:12.914205 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-85632dd3-4f10-466b-8906-9459786fa137 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:14:12.916117 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-85632dd3-4f10-466b-8906-9459786fa137 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] [instance: ecfcd452-b06e-4723-b091-7992c79c9e72] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:14:12.922467 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-85632dd3-4f10-466b-8906-9459786fa137 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:12.922946 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-85632dd3-4f10-466b-8906-9459786fa137 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:12.923919 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-85632dd3-4f10-466b-8906-9459786fa137 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:12.924375 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-85632dd3-4f10-466b-8906-9459786fa137 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:13.207973 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-85632dd3-4f10-466b-8906-9459786fa137 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e4dc563e8e4d80817bb8b3937768b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df73e9a151d74cbfa33bed295c7c3be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:14:13.216215 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-85632dd3-4f10-466b-8906-9459786fa137 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] 10.222.0.46 "GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72" status: 200 len: 1570 microversion: 2.1 time: 0.306726 Nov 16 16:14:13.216774 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 535/1088] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:14:12 2021] GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72 => generated 1570 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:14:14.234946 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-df365494-152d-445a-a340-95a21ee3e34d tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:14:14.235672 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-df365494-152d-445a-a340-95a21ee3e34d tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] [instance: ecfcd452-b06e-4723-b091-7992c79c9e72] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:14:14.241752 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-df365494-152d-445a-a340-95a21ee3e34d tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:14.242196 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-df365494-152d-445a-a340-95a21ee3e34d tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:14.242966 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-df365494-152d-445a-a340-95a21ee3e34d tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:14.244058 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-df365494-152d-445a-a340-95a21ee3e34d tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:14.432180 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-df365494-152d-445a-a340-95a21ee3e34d tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e4dc563e8e4d80817bb8b3937768b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df73e9a151d74cbfa33bed295c7c3be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:14:14.439458 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-df365494-152d-445a-a340-95a21ee3e34d tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] 10.222.0.46 "GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72" status: 200 len: 1570 microversion: 2.1 time: 0.209102 Nov 16 16:14:14.440041 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 554/1089] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:14:14 2021] GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72 => generated 1570 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:14:15.456422 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-cb32e4c0-df6d-4880-85c3-81716315f349 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:14:15.457057 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-cb32e4c0-df6d-4880-85c3-81716315f349 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] [instance: ecfcd452-b06e-4723-b091-7992c79c9e72] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:14:15.463575 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cb32e4c0-df6d-4880-85c3-81716315f349 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:15.464022 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cb32e4c0-df6d-4880-85c3-81716315f349 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:15.464799 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cb32e4c0-df6d-4880-85c3-81716315f349 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:15.465235 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cb32e4c0-df6d-4880-85c3-81716315f349 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:15.597202 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-cb32e4c0-df6d-4880-85c3-81716315f349 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e4dc563e8e4d80817bb8b3937768b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df73e9a151d74cbfa33bed295c7c3be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:14:15.605252 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-cb32e4c0-df6d-4880-85c3-81716315f349 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] 10.222.0.46 "GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72" status: 200 len: 1570 microversion: 2.1 time: 0.152590 Nov 16 16:14:15.605817 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 536/1090] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:14:15 2021] GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:14:16.622781 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-dd51f580-962f-431e-b5ca-ad7fe601d19e tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:14:16.623389 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-dd51f580-962f-431e-b5ca-ad7fe601d19e tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] [instance: ecfcd452-b06e-4723-b091-7992c79c9e72] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:14:16.629416 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dd51f580-962f-431e-b5ca-ad7fe601d19e tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:16.629863 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dd51f580-962f-431e-b5ca-ad7fe601d19e tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:16.630635 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dd51f580-962f-431e-b5ca-ad7fe601d19e tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:16.631070 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dd51f580-962f-431e-b5ca-ad7fe601d19e tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:16.766409 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-dd51f580-962f-431e-b5ca-ad7fe601d19e tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e4dc563e8e4d80817bb8b3937768b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df73e9a151d74cbfa33bed295c7c3be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:14:16.773980 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-dd51f580-962f-431e-b5ca-ad7fe601d19e tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] 10.222.0.46 "GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72" status: 200 len: 1570 microversion: 2.1 time: 0.155472 Nov 16 16:14:16.774627 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 555/1091] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:14:16 2021] GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:14:17.791316 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-83698fea-782b-466b-b0e5-4f2981de4bb5 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:14:17.791954 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-83698fea-782b-466b-b0e5-4f2981de4bb5 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] [instance: ecfcd452-b06e-4723-b091-7992c79c9e72] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:14:17.798183 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-83698fea-782b-466b-b0e5-4f2981de4bb5 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:17.798634 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-83698fea-782b-466b-b0e5-4f2981de4bb5 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:17.799406 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-83698fea-782b-466b-b0e5-4f2981de4bb5 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:17.799866 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-83698fea-782b-466b-b0e5-4f2981de4bb5 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:17.932855 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-83698fea-782b-466b-b0e5-4f2981de4bb5 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e4dc563e8e4d80817bb8b3937768b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df73e9a151d74cbfa33bed295c7c3be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:14:17.940202 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-83698fea-782b-466b-b0e5-4f2981de4bb5 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] 10.222.0.46 "GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72" status: 200 len: 1570 microversion: 2.1 time: 0.152695 Nov 16 16:14:17.940767 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 537/1092] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:14:17 2021] GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:14:18.957727 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-5d310acd-478c-486e-94ee-0fdaecf850be tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:14:18.958320 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-5d310acd-478c-486e-94ee-0fdaecf850be tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] [instance: ecfcd452-b06e-4723-b091-7992c79c9e72] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:14:18.964496 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5d310acd-478c-486e-94ee-0fdaecf850be tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:18.964938 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5d310acd-478c-486e-94ee-0fdaecf850be tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:18.965712 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5d310acd-478c-486e-94ee-0fdaecf850be tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:18.966143 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5d310acd-478c-486e-94ee-0fdaecf850be tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:19.101634 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-5d310acd-478c-486e-94ee-0fdaecf850be tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e4dc563e8e4d80817bb8b3937768b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df73e9a151d74cbfa33bed295c7c3be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:14:19.109281 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-5d310acd-478c-486e-94ee-0fdaecf850be tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] 10.222.0.46 "GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72" status: 200 len: 1570 microversion: 2.1 time: 0.155356 Nov 16 16:14:19.109850 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 556/1093] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:14:18 2021] GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:14:20.126066 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-564db7f5-0a55-4d71-b4f4-bb101d9a97ff tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:14:20.126719 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-564db7f5-0a55-4d71-b4f4-bb101d9a97ff tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] [instance: ecfcd452-b06e-4723-b091-7992c79c9e72] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:14:20.135346 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-564db7f5-0a55-4d71-b4f4-bb101d9a97ff tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:20.135908 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-564db7f5-0a55-4d71-b4f4-bb101d9a97ff tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:20.137382 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-564db7f5-0a55-4d71-b4f4-bb101d9a97ff tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:20.137960 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-564db7f5-0a55-4d71-b4f4-bb101d9a97ff tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:20.297573 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-564db7f5-0a55-4d71-b4f4-bb101d9a97ff tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e4dc563e8e4d80817bb8b3937768b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df73e9a151d74cbfa33bed295c7c3be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:14:20.305145 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-564db7f5-0a55-4d71-b4f4-bb101d9a97ff tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] 10.222.0.46 "GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72" status: 200 len: 1570 microversion: 2.1 time: 0.182721 Nov 16 16:14:20.305712 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 538/1094] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:14:20 2021] GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72 => generated 1570 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:14:21.324276 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1b7bdcf8-d67e-434d-9d6d-f38f1bd41155 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:14:21.324959 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1b7bdcf8-d67e-434d-9d6d-f38f1bd41155 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] [instance: ecfcd452-b06e-4723-b091-7992c79c9e72] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:14:21.331158 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1b7bdcf8-d67e-434d-9d6d-f38f1bd41155 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:21.331651 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1b7bdcf8-d67e-434d-9d6d-f38f1bd41155 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:21.332430 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1b7bdcf8-d67e-434d-9d6d-f38f1bd41155 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:21.332864 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1b7bdcf8-d67e-434d-9d6d-f38f1bd41155 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:21.464221 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1b7bdcf8-d67e-434d-9d6d-f38f1bd41155 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e4dc563e8e4d80817bb8b3937768b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df73e9a151d74cbfa33bed295c7c3be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:14:21.471486 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1b7bdcf8-d67e-434d-9d6d-f38f1bd41155 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] 10.222.0.46 "GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72" status: 200 len: 1570 microversion: 2.1 time: 0.150992 Nov 16 16:14:21.472052 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 557/1095] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:14:21 2021] GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:14:22.489099 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-c820e196-b375-4df5-aa70-db32597a3d76 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:14:22.489693 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-c820e196-b375-4df5-aa70-db32597a3d76 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] [instance: ecfcd452-b06e-4723-b091-7992c79c9e72] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:14:22.496215 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c820e196-b375-4df5-aa70-db32597a3d76 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:22.496707 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c820e196-b375-4df5-aa70-db32597a3d76 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:22.497458 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c820e196-b375-4df5-aa70-db32597a3d76 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:22.497895 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c820e196-b375-4df5-aa70-db32597a3d76 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:22.632274 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-c820e196-b375-4df5-aa70-db32597a3d76 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e4dc563e8e4d80817bb8b3937768b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df73e9a151d74cbfa33bed295c7c3be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:14:22.640200 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-c820e196-b375-4df5-aa70-db32597a3d76 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] 10.222.0.46 "GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72" status: 200 len: 1570 microversion: 2.1 time: 0.154786 Nov 16 16:14:22.640769 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 539/1096] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:14:22 2021] GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:14:23.657258 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a981291e-6309-4a2f-b31c-67856e1ccf0d tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:14:23.657844 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-a981291e-6309-4a2f-b31c-67856e1ccf0d tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] [instance: ecfcd452-b06e-4723-b091-7992c79c9e72] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:14:23.664115 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a981291e-6309-4a2f-b31c-67856e1ccf0d tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:23.664559 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a981291e-6309-4a2f-b31c-67856e1ccf0d tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:23.665330 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a981291e-6309-4a2f-b31c-67856e1ccf0d tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:23.666318 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a981291e-6309-4a2f-b31c-67856e1ccf0d tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:23.802635 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-a981291e-6309-4a2f-b31c-67856e1ccf0d tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e4dc563e8e4d80817bb8b3937768b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df73e9a151d74cbfa33bed295c7c3be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:14:23.810524 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-a981291e-6309-4a2f-b31c-67856e1ccf0d tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] 10.222.0.46 "GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72" status: 200 len: 1570 microversion: 2.1 time: 0.156910 Nov 16 16:14:23.811099 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 558/1097] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:14:23 2021] GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:14:24.827376 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-65d304c3-2270-472b-82bd-91ef1ef6bf20 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:14:24.828037 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-65d304c3-2270-472b-82bd-91ef1ef6bf20 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] [instance: ecfcd452-b06e-4723-b091-7992c79c9e72] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:14:24.834277 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-65d304c3-2270-472b-82bd-91ef1ef6bf20 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:24.834726 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-65d304c3-2270-472b-82bd-91ef1ef6bf20 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:24.835516 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-65d304c3-2270-472b-82bd-91ef1ef6bf20 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:24.835950 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-65d304c3-2270-472b-82bd-91ef1ef6bf20 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:24.967711 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-65d304c3-2270-472b-82bd-91ef1ef6bf20 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e4dc563e8e4d80817bb8b3937768b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df73e9a151d74cbfa33bed295c7c3be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:14:24.975540 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-65d304c3-2270-472b-82bd-91ef1ef6bf20 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] 10.222.0.46 "GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72" status: 200 len: 1570 microversion: 2.1 time: 0.151759 Nov 16 16:14:24.976110 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 540/1098] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:14:24 2021] GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:14:25.993051 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-224b95e4-a47d-4202-ac16-3aba35d25633 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:14:25.993605 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-224b95e4-a47d-4202-ac16-3aba35d25633 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] [instance: ecfcd452-b06e-4723-b091-7992c79c9e72] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:14:25.999893 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-224b95e4-a47d-4202-ac16-3aba35d25633 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:26.000331 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-224b95e4-a47d-4202-ac16-3aba35d25633 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:26.001093 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-224b95e4-a47d-4202-ac16-3aba35d25633 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:26.001519 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-224b95e4-a47d-4202-ac16-3aba35d25633 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:26.135183 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-224b95e4-a47d-4202-ac16-3aba35d25633 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e4dc563e8e4d80817bb8b3937768b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df73e9a151d74cbfa33bed295c7c3be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:14:26.143029 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-224b95e4-a47d-4202-ac16-3aba35d25633 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] 10.222.0.46 "GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72" status: 200 len: 1511 microversion: 2.1 time: 0.153722 Nov 16 16:14:26.143615 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 559/1099] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:14:25 2021] GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72 => generated 1511 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:14:26.160143 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-e3579be3-1fb7-4d24-b33c-d089571fd4c3 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:14:26.160714 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-e3579be3-1fb7-4d24-b33c-d089571fd4c3 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] [instance: ecfcd452-b06e-4723-b091-7992c79c9e72] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:14:26.167019 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e3579be3-1fb7-4d24-b33c-d089571fd4c3 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:26.167487 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e3579be3-1fb7-4d24-b33c-d089571fd4c3 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:26.168284 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e3579be3-1fb7-4d24-b33c-d089571fd4c3 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:26.168720 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e3579be3-1fb7-4d24-b33c-d089571fd4c3 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:26.239871 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-e3579be3-1fb7-4d24-b33c-d089571fd4c3 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] 10.222.0.46 "POST /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72/action" status: 202 len: 0 microversion: 2.1 time: 0.083367 Nov 16 16:14:26.240478 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 541/1100] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 16:14:26 2021] POST /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:14:26.249349 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ee390ba5-220f-4450-a68d-c24581e1b87e tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:14:26.249892 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ee390ba5-220f-4450-a68d-c24581e1b87e tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] [instance: ecfcd452-b06e-4723-b091-7992c79c9e72] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:14:26.255787 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ee390ba5-220f-4450-a68d-c24581e1b87e tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:26.256239 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ee390ba5-220f-4450-a68d-c24581e1b87e tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:26.257024 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ee390ba5-220f-4450-a68d-c24581e1b87e tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:26.257463 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ee390ba5-220f-4450-a68d-c24581e1b87e tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:26.401124 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ee390ba5-220f-4450-a68d-c24581e1b87e tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e4dc563e8e4d80817bb8b3937768b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df73e9a151d74cbfa33bed295c7c3be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:14:26.409111 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ee390ba5-220f-4450-a68d-c24581e1b87e tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] 10.222.0.46 "GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72" status: 200 len: 1519 microversion: 2.1 time: 0.164345 Nov 16 16:14:26.410792 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 560/1101] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:14:26 2021] GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:14:27.426302 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-d0b4f5de-5bfd-4342-a8c6-349f533b9eaf tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:14:27.426910 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-d0b4f5de-5bfd-4342-a8c6-349f533b9eaf tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] [instance: ecfcd452-b06e-4723-b091-7992c79c9e72] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:14:27.432871 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d0b4f5de-5bfd-4342-a8c6-349f533b9eaf tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:27.434688 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d0b4f5de-5bfd-4342-a8c6-349f533b9eaf tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:27.435502 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d0b4f5de-5bfd-4342-a8c6-349f533b9eaf tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:27.435936 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d0b4f5de-5bfd-4342-a8c6-349f533b9eaf tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:27.575487 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-8cbc86b1-8010-4ecf-97d7-85c0de982dee req-9e64a4e5-603e-46ae-893e-fcf05d555413 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecfcd452-b06e-4723-b091-7992c79c9e72", "name": "network-vif-unplugged", "status": "completed", "tag": "14b10c18-97ea-4e1d-ab84-3f7bc7632b4c"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:14:27.577103 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:14:27.577103 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Nov 16 16:14:27.585070 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-8cbc86b1-8010-4ecf-97d7-85c0de982dee req-9e64a4e5-603e-46ae-893e-fcf05d555413 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:27.585251 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-d0b4f5de-5bfd-4342-a8c6-349f533b9eaf tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e4dc563e8e4d80817bb8b3937768b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df73e9a151d74cbfa33bed295c7c3be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:14:27.585921 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-8cbc86b1-8010-4ecf-97d7-85c0de982dee req-9e64a4e5-603e-46ae-893e-fcf05d555413 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:27.594144 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-d0b4f5de-5bfd-4342-a8c6-349f533b9eaf tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] 10.222.0.46 "GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72" status: 200 len: 1521 microversion: 2.1 time: 0.171855 Nov 16 16:14:27.594721 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 542/1102] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:14:27 2021] GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:14:27.607592 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-8cbc86b1-8010-4ecf-97d7-85c0de982dee req-9e64a4e5-603e-46ae-893e-fcf05d555413 service nova] Creating event network-vif-unplugged:14b10c18-97ea-4e1d-ab84-3f7bc7632b4c for instance ecfcd452-b06e-4723-b091-7992c79c9e72 on hv-cinder-81809 Nov 16 16:14:27.612661 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-8cbc86b1-8010-4ecf-97d7-85c0de982dee req-9e64a4e5-603e-46ae-893e-fcf05d555413 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041069 Nov 16 16:14:27.613261 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 561/1103] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:14:27 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:14:28.611357 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-c8c1a28a-6658-4a1e-944f-ab430cbb4066 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:14:28.612005 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-c8c1a28a-6658-4a1e-944f-ab430cbb4066 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] [instance: ecfcd452-b06e-4723-b091-7992c79c9e72] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:14:28.618289 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c8c1a28a-6658-4a1e-944f-ab430cbb4066 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:28.618740 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c8c1a28a-6658-4a1e-944f-ab430cbb4066 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:28.619546 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c8c1a28a-6658-4a1e-944f-ab430cbb4066 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:28.619985 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c8c1a28a-6658-4a1e-944f-ab430cbb4066 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:28.752481 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-c8c1a28a-6658-4a1e-944f-ab430cbb4066 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e4dc563e8e4d80817bb8b3937768b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df73e9a151d74cbfa33bed295c7c3be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:14:28.759761 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-c8c1a28a-6658-4a1e-944f-ab430cbb4066 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] 10.222.0.46 "GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72" status: 200 len: 1577 microversion: 2.1 time: 0.152142 Nov 16 16:14:28.760325 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 543/1104] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:14:28 2021] GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:14:29.778721 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e085d21c-b412-4fcc-a00b-159a08dadcb0 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:14:29.779418 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e085d21c-b412-4fcc-a00b-159a08dadcb0 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] [instance: ecfcd452-b06e-4723-b091-7992c79c9e72] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:14:29.786196 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e085d21c-b412-4fcc-a00b-159a08dadcb0 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:29.786649 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e085d21c-b412-4fcc-a00b-159a08dadcb0 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:29.787428 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e085d21c-b412-4fcc-a00b-159a08dadcb0 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:29.787891 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e085d21c-b412-4fcc-a00b-159a08dadcb0 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:29.921825 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e085d21c-b412-4fcc-a00b-159a08dadcb0 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e4dc563e8e4d80817bb8b3937768b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df73e9a151d74cbfa33bed295c7c3be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:14:29.929072 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e085d21c-b412-4fcc-a00b-159a08dadcb0 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] 10.222.0.46 "GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72" status: 200 len: 1577 microversion: 2.1 time: 0.155344 Nov 16 16:14:29.929638 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 562/1105] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:14:29 2021] GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:14:30.945838 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-e2bb64f2-91de-4c08-9e98-ecc58fac2823 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:14:30.946380 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-e2bb64f2-91de-4c08-9e98-ecc58fac2823 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] [instance: ecfcd452-b06e-4723-b091-7992c79c9e72] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:14:30.952942 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e2bb64f2-91de-4c08-9e98-ecc58fac2823 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:30.953391 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e2bb64f2-91de-4c08-9e98-ecc58fac2823 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:30.954164 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e2bb64f2-91de-4c08-9e98-ecc58fac2823 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:30.954599 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e2bb64f2-91de-4c08-9e98-ecc58fac2823 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:31.086233 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-e2bb64f2-91de-4c08-9e98-ecc58fac2823 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e4dc563e8e4d80817bb8b3937768b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df73e9a151d74cbfa33bed295c7c3be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:14:31.094188 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-e2bb64f2-91de-4c08-9e98-ecc58fac2823 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] 10.222.0.46 "GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72" status: 200 len: 1577 microversion: 2.1 time: 0.152111 Nov 16 16:14:31.094757 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 544/1106] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:14:30 2021] GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:14:32.111000 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-57473fe5-1421-4040-8740-4047acef711c tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:14:32.111620 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-57473fe5-1421-4040-8740-4047acef711c tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] [instance: ecfcd452-b06e-4723-b091-7992c79c9e72] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:14:32.117872 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-57473fe5-1421-4040-8740-4047acef711c tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:32.118321 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-57473fe5-1421-4040-8740-4047acef711c tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:32.119091 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-57473fe5-1421-4040-8740-4047acef711c tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:32.119549 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-57473fe5-1421-4040-8740-4047acef711c tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:32.252536 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-57473fe5-1421-4040-8740-4047acef711c tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e4dc563e8e4d80817bb8b3937768b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df73e9a151d74cbfa33bed295c7c3be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:14:32.259837 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-57473fe5-1421-4040-8740-4047acef711c tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] 10.222.0.46 "GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72" status: 200 len: 1577 microversion: 2.1 time: 0.152503 Nov 16 16:14:32.260403 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 563/1107] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:14:32 2021] GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:14:33.277212 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-796a1fda-338e-403a-bf6c-7b908178d193 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:14:33.277955 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-796a1fda-338e-403a-bf6c-7b908178d193 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] [instance: ecfcd452-b06e-4723-b091-7992c79c9e72] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:14:33.284388 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-796a1fda-338e-403a-bf6c-7b908178d193 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:33.284828 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-796a1fda-338e-403a-bf6c-7b908178d193 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:33.285600 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-796a1fda-338e-403a-bf6c-7b908178d193 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:33.286028 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-796a1fda-338e-403a-bf6c-7b908178d193 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:33.575155 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-796a1fda-338e-403a-bf6c-7b908178d193 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e4dc563e8e4d80817bb8b3937768b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df73e9a151d74cbfa33bed295c7c3be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:14:33.582534 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-796a1fda-338e-403a-bf6c-7b908178d193 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] 10.222.0.46 "GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72" status: 200 len: 1577 microversion: 2.1 time: 0.309715 Nov 16 16:14:33.583117 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 545/1108] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:14:33 2021] GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72 => generated 1577 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:14:34.600037 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c6e3ac78-6a42-4c04-be0a-6f11eada4e3f tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:14:34.600644 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c6e3ac78-6a42-4c04-be0a-6f11eada4e3f tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] [instance: ecfcd452-b06e-4723-b091-7992c79c9e72] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:14:34.607036 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c6e3ac78-6a42-4c04-be0a-6f11eada4e3f tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:34.607507 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c6e3ac78-6a42-4c04-be0a-6f11eada4e3f tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:34.608288 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c6e3ac78-6a42-4c04-be0a-6f11eada4e3f tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:34.608721 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c6e3ac78-6a42-4c04-be0a-6f11eada4e3f tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:34.738973 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-c6e3ac78-6a42-4c04-be0a-6f11eada4e3f tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e4dc563e8e4d80817bb8b3937768b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df73e9a151d74cbfa33bed295c7c3be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:14:34.746989 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c6e3ac78-6a42-4c04-be0a-6f11eada4e3f tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] 10.222.0.46 "GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72" status: 200 len: 1577 microversion: 2.1 time: 0.150601 Nov 16 16:14:34.747567 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 564/1109] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:14:34 2021] GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72 => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:14:35.763406 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-ffab314c-bbf9-41fb-ae9c-01c2ae526c0f tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:14:35.764113 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-ffab314c-bbf9-41fb-ae9c-01c2ae526c0f tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] [instance: ecfcd452-b06e-4723-b091-7992c79c9e72] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:14:35.770011 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ffab314c-bbf9-41fb-ae9c-01c2ae526c0f tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:35.770458 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ffab314c-bbf9-41fb-ae9c-01c2ae526c0f tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:35.771258 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ffab314c-bbf9-41fb-ae9c-01c2ae526c0f tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:35.771725 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ffab314c-bbf9-41fb-ae9c-01c2ae526c0f tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:35.907828 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-ffab314c-bbf9-41fb-ae9c-01c2ae526c0f tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e4dc563e8e4d80817bb8b3937768b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df73e9a151d74cbfa33bed295c7c3be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:14:35.915149 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-ffab314c-bbf9-41fb-ae9c-01c2ae526c0f tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] 10.222.0.46 "GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72" status: 200 len: 1577 microversion: 2.1 time: 0.156022 Nov 16 16:14:35.915737 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 546/1110] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:14:35 2021] GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:14:36.932059 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b6eb913e-bc04-4341-9da0-0f0b144327d7 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:14:36.932597 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b6eb913e-bc04-4341-9da0-0f0b144327d7 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] [instance: ecfcd452-b06e-4723-b091-7992c79c9e72] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:14:36.939363 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b6eb913e-bc04-4341-9da0-0f0b144327d7 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:36.939835 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b6eb913e-bc04-4341-9da0-0f0b144327d7 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:36.940611 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b6eb913e-bc04-4341-9da0-0f0b144327d7 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:36.941042 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b6eb913e-bc04-4341-9da0-0f0b144327d7 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:37.082052 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b6eb913e-bc04-4341-9da0-0f0b144327d7 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e4dc563e8e4d80817bb8b3937768b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df73e9a151d74cbfa33bed295c7c3be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:14:37.089564 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b6eb913e-bc04-4341-9da0-0f0b144327d7 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] 10.222.0.46 "GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72" status: 200 len: 1577 microversion: 2.1 time: 0.161067 Nov 16 16:14:37.090140 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 565/1111] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:14:36 2021] GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72 => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:14:37.660604 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-8c51ba02-d492-4329-9ec6-6e55fafb3c92 req-9ce50137-ac26-4f5d-946d-993bba25b85d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecfcd452-b06e-4723-b091-7992c79c9e72", "name": "network-vif-plugged", "status": "completed", "tag": "14b10c18-97ea-4e1d-ab84-3f7bc7632b4c"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:14:37.662106 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:14:37.662106 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Nov 16 16:14:37.670214 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-8c51ba02-d492-4329-9ec6-6e55fafb3c92 req-9ce50137-ac26-4f5d-946d-993bba25b85d service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:37.670778 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-8c51ba02-d492-4329-9ec6-6e55fafb3c92 req-9ce50137-ac26-4f5d-946d-993bba25b85d service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:37.682259 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-8c51ba02-d492-4329-9ec6-6e55fafb3c92 req-9ce50137-ac26-4f5d-946d-993bba25b85d service nova] Creating event network-vif-plugged:14b10c18-97ea-4e1d-ab84-3f7bc7632b4c for instance ecfcd452-b06e-4723-b091-7992c79c9e72 on hv-cinder-81809 Nov 16 16:14:37.688754 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-8c51ba02-d492-4329-9ec6-6e55fafb3c92 req-9ce50137-ac26-4f5d-946d-993bba25b85d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031972 Nov 16 16:14:37.689333 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 547/1112] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:14:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:14:38.106874 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7c47a5ca-e35d-4e4f-9d33-c13a23f08065 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:14:38.107483 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-7c47a5ca-e35d-4e4f-9d33-c13a23f08065 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] [instance: ecfcd452-b06e-4723-b091-7992c79c9e72] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:14:38.113807 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7c47a5ca-e35d-4e4f-9d33-c13a23f08065 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:38.114257 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7c47a5ca-e35d-4e4f-9d33-c13a23f08065 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:38.115016 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7c47a5ca-e35d-4e4f-9d33-c13a23f08065 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:38.115445 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7c47a5ca-e35d-4e4f-9d33-c13a23f08065 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:38.247590 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7c47a5ca-e35d-4e4f-9d33-c13a23f08065 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e4dc563e8e4d80817bb8b3937768b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df73e9a151d74cbfa33bed295c7c3be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:14:38.254904 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-7c47a5ca-e35d-4e4f-9d33-c13a23f08065 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] 10.222.0.46 "GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72" status: 200 len: 1577 microversion: 2.1 time: 0.152720 Nov 16 16:14:38.255475 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 566/1113] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:14:38 2021] GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:14:39.273162 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-d550081d-c26a-438c-b8de-8dca0d25d86d tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:14:39.274108 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-d550081d-c26a-438c-b8de-8dca0d25d86d tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] [instance: ecfcd452-b06e-4723-b091-7992c79c9e72] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:14:39.280543 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d550081d-c26a-438c-b8de-8dca0d25d86d tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:39.280988 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d550081d-c26a-438c-b8de-8dca0d25d86d tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:39.281756 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d550081d-c26a-438c-b8de-8dca0d25d86d tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:39.282190 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d550081d-c26a-438c-b8de-8dca0d25d86d tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:39.413352 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-d550081d-c26a-438c-b8de-8dca0d25d86d tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e4dc563e8e4d80817bb8b3937768b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df73e9a151d74cbfa33bed295c7c3be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:14:39.421816 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-d550081d-c26a-438c-b8de-8dca0d25d86d tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] 10.222.0.46 "GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72" status: 200 len: 1564 microversion: 2.1 time: 0.153055 Nov 16 16:14:39.422372 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 548/1114] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:14:39 2021] GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72 => generated 1564 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:55.779905 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e1dc76bd-88d4-4db2-a4f8-78ba9761248b tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:55.780546 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e1dc76bd-88d4-4db2-a4f8-78ba9761248b tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] [instance: ecfcd452-b06e-4723-b091-7992c79c9e72] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:55.786457 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e1dc76bd-88d4-4db2-a4f8-78ba9761248b tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:55.786909 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e1dc76bd-88d4-4db2-a4f8-78ba9761248b tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:55.787724 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e1dc76bd-88d4-4db2-a4f8-78ba9761248b tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:55.788161 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e1dc76bd-88d4-4db2-a4f8-78ba9761248b tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:55.813376 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e1dc76bd-88d4-4db2-a4f8-78ba9761248b tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] [instance: ecfcd452-b06e-4723-b091-7992c79c9e72] Going to try to terminate instance {{(pid=116084) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 16:15:55.854298 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-6d0ca24f-3e6e-415b-8274-1109ca356860 req-a4bc24c5-64de-494d-a889-a5bd3b0ddde3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecfcd452-b06e-4723-b091-7992c79c9e72", "tag": "14b10c18-97ea-4e1d-ab84-3f7bc7632b4c"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:15:55.856137 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:15:55.856137 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Nov 16 16:15:55.863491 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-6d0ca24f-3e6e-415b-8274-1109ca356860 req-a4bc24c5-64de-494d-a889-a5bd3b0ddde3 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:55.863958 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-6d0ca24f-3e6e-415b-8274-1109ca356860 req-a4bc24c5-64de-494d-a889-a5bd3b0ddde3 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:55.875618 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-6d0ca24f-3e6e-415b-8274-1109ca356860 req-a4bc24c5-64de-494d-a889-a5bd3b0ddde3 service nova] Creating event network-changed:14b10c18-97ea-4e1d-ab84-3f7bc7632b4c for instance ecfcd452-b06e-4723-b091-7992c79c9e72 on hv-cinder-81809 Nov 16 16:15:55.880886 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-6d0ca24f-3e6e-415b-8274-1109ca356860 req-a4bc24c5-64de-494d-a889-a5bd3b0ddde3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102491 Nov 16 16:15:55.881510 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 549/1115] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:15:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:15:55.900825 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e1dc76bd-88d4-4db2-a4f8-78ba9761248b tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72" status: 204 len: 0 microversion: 2.1 time: 0.126100 Nov 16 16:15:55.902121 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 567/1116] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 16 16:15:55 2021] DELETE /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 16:15:55.910886 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-6a0c8c3f-220b-45c5-8787-31dff1f121a5 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:55.911600 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-6a0c8c3f-220b-45c5-8787-31dff1f121a5 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] [instance: ecfcd452-b06e-4723-b091-7992c79c9e72] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:55.917558 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6a0c8c3f-220b-45c5-8787-31dff1f121a5 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:55.917996 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6a0c8c3f-220b-45c5-8787-31dff1f121a5 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:55.918814 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6a0c8c3f-220b-45c5-8787-31dff1f121a5 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:55.919818 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6a0c8c3f-220b-45c5-8787-31dff1f121a5 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:56.064716 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-6a0c8c3f-220b-45c5-8787-31dff1f121a5 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e4dc563e8e4d80817bb8b3937768b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df73e9a151d74cbfa33bed295c7c3be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:56.071803 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-6a0c8c3f-220b-45c5-8787-31dff1f121a5 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] 10.222.0.46 "GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72" status: 200 len: 1570 microversion: 2.1 time: 0.164789 Nov 16 16:15:56.072589 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 550/1117] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:55 2021] GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72 => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:57.089495 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-4dde7bf7-2a3d-4d02-a655-d5c9507f6634 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:57.090111 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-4dde7bf7-2a3d-4d02-a655-d5c9507f6634 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] [instance: ecfcd452-b06e-4723-b091-7992c79c9e72] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:57.097188 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4dde7bf7-2a3d-4d02-a655-d5c9507f6634 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:57.097635 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4dde7bf7-2a3d-4d02-a655-d5c9507f6634 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:57.098416 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4dde7bf7-2a3d-4d02-a655-d5c9507f6634 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:57.098911 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4dde7bf7-2a3d-4d02-a655-d5c9507f6634 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:57.236297 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-4dde7bf7-2a3d-4d02-a655-d5c9507f6634 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e4dc563e8e4d80817bb8b3937768b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df73e9a151d74cbfa33bed295c7c3be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:57.243665 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-4dde7bf7-2a3d-4d02-a655-d5c9507f6634 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] 10.222.0.46 "GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72" status: 200 len: 1451 microversion: 2.1 time: 0.158297 Nov 16 16:15:57.244229 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 568/1118] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:57 2021] GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72 => generated 1451 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:15:57.957342 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-8e390d30-3299-42cb-82d7-3608dd47a938 req-4c69022a-0bfc-45f2-a840-e9ae61235f05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecfcd452-b06e-4723-b091-7992c79c9e72", "name": "network-vif-deleted", "tag": "14b10c18-97ea-4e1d-ab84-3f7bc7632b4c"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:15:57.958856 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:15:57.958856 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Nov 16 16:15:57.965883 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-8e390d30-3299-42cb-82d7-3608dd47a938 req-4c69022a-0bfc-45f2-a840-e9ae61235f05 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:57.966444 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-8e390d30-3299-42cb-82d7-3608dd47a938 req-4c69022a-0bfc-45f2-a840-e9ae61235f05 service nova] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:57.977049 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-8e390d30-3299-42cb-82d7-3608dd47a938 req-4c69022a-0bfc-45f2-a840-e9ae61235f05 service nova] Creating event network-vif-deleted:14b10c18-97ea-4e1d-ab84-3f7bc7632b4c for instance ecfcd452-b06e-4723-b091-7992c79c9e72 on hv-cinder-81809 Nov 16 16:15:57.981735 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-8e390d30-3299-42cb-82d7-3608dd47a938 req-4c69022a-0bfc-45f2-a840-e9ae61235f05 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089140 Nov 16 16:15:57.982469 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 551/1119] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 16:15:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:15:58.261721 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-9c3c49a4-2197-4f63-b305-877308ed5f06 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:58.268367 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-9c3c49a4-2197-4f63-b305-877308ed5f06 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] [instance: ecfcd452-b06e-4723-b091-7992c79c9e72] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:58.276698 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9c3c49a4-2197-4f63-b305-877308ed5f06 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:58.277150 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9c3c49a4-2197-4f63-b305-877308ed5f06 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:58.277950 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9c3c49a4-2197-4f63-b305-877308ed5f06 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:58.279092 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9c3c49a4-2197-4f63-b305-877308ed5f06 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:58.314754 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9c3c49a4-2197-4f63-b305-877308ed5f06 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:58.315206 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9c3c49a4-2197-4f63-b305-877308ed5f06 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:58.315705 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.objects.instance [None req-9c3c49a4-2197-4f63-b305-877308ed5f06 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lazy-loading 'fault' on Instance uuid ecfcd452-b06e-4723-b091-7992c79c9e72 {{(pid=116084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:15:58.355783 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-9c3c49a4-2197-4f63-b305-877308ed5f06 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e4dc563e8e4d80817bb8b3937768b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df73e9a151d74cbfa33bed295c7c3be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:58.365901 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-9c3c49a4-2197-4f63-b305-877308ed5f06 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] 10.222.0.46 "GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72" status: 200 len: 1224 microversion: 2.1 time: 0.108210 Nov 16 16:15:58.366451 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 569/1120] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:58 2021] GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72 => generated 1224 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:59.385438 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-d35ef11e-d731-464e-adba-58b27f3bb446 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:59.386116 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-d35ef11e-d731-464e-adba-58b27f3bb446 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] [instance: ecfcd452-b06e-4723-b091-7992c79c9e72] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:59.392773 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d35ef11e-d731-464e-adba-58b27f3bb446 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:59.393220 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d35ef11e-d731-464e-adba-58b27f3bb446 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:59.393991 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d35ef11e-d731-464e-adba-58b27f3bb446 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:59.394454 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d35ef11e-d731-464e-adba-58b27f3bb446 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Lock "153e4b82-24f7-482f-a6a4-3a6422fd3ad2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:59.407392 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.wsgi [None req-d35ef11e-d731-464e-adba-58b27f3bb446 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] HTTP exception thrown: Instance ecfcd452-b06e-4723-b091-7992c79c9e72 could not be found. Nov 16 16:15:59.407996 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-d35ef11e-d731-464e-adba-58b27f3bb446 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Returning 404 to user: Instance ecfcd452-b06e-4723-b091-7992c79c9e72 could not be found. {{(pid=116085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:15:59.408802 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-d35ef11e-d731-464e-adba-58b27f3bb446 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] 10.222.0.46 "GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72" status: 404 len: 111 microversion: 2.1 time: 0.027862 Nov 16 16:15:59.409328 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 552/1121] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:59 2021] GET /compute/v2.1/servers/ecfcd452-b06e-4723-b091-7992c79c9e72 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:15:59.568975 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-35ad7a5e-a9e3-40d2-bd70-59a6c1d670d0 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] Calling method '.version_select at 0x7f113c3784c0>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:59.591060 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-35ad7a5e-a9e3-40d2-bd70-59a6c1d670d0 tempest-TestShelveInstance-466520473 tempest-TestShelveInstance-466520473-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1370474868" status: 202 len: 0 microversion: 2.1 time: 0.025571 Nov 16 16:15:59.595046 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 570/1122] 10.222.0.46 () {58 vars in 1253 bytes} [Tue Nov 16 16:15:59 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1370474868 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:17:11.183815 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 16 16:17:11.184600 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: Tue Nov 16 16:17:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 16 16:17:22.153494 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 16 16:17:22.154110 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: Tue Nov 16 16:17:22 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 16 16:19:04.998828 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 16 16:19:04.999434 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: Tue Nov 16 16:19:04 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 16 16:19:06.678089 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 16 16:19:06.678527 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: Tue Nov 16 16:19:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 16 16:19:11.672373 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 16 16:19:11.673061 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: Tue Nov 16 16:19:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 16 16:20:31.202229 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 16 16:20:31.202873 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: Tue Nov 16 16:20:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 16 16:20:42.171033 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 16 16:20:42.171660 dv-cinder-818098-2-iscsi devstack@n-api.service[116085]: Tue Nov 16 16:20:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 16 16:21:07.429748 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 16 16:21:07.430387 dv-cinder-818098-2-iscsi devstack@n-api.service[116084]: Tue Nov 16 16:21:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!